00000001:02000400:3.0F:1787707047.828404:0:2970:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg446-server.virtnet: executing set_hostid 00000001:02000400:3.0:1787707067.449224:0:3190:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg446-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787707069.114782:0:3251:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 817 MB/s 00000001:01000000:2.0:1787707069.365039:0:3251:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1115 MB/s 00000001:01000000:0.0F:1787707069.614480:0:3251:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6255 MB/s 00000020:02000000:2.0:1787707070.354623:0:3283:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_80_gcb5c033 00000400:02000000:2.0:1787707071.058965:0:3298:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.146@tcp [8/256/0/180] 00008000:02000000:1.0F:1787707074.671750:0:3447:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787707127.579097:0:5250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg446-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787707137.214931:0:5837:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787707137.214938:0:5837:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787707137.215090:0:5837:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000057e7f6fe 00000080:02000400:2.0:1787707137.215102:0:5837:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787707137.219290:0:5837:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787707137.219303:0:5837:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787707137.219419:0:5837:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000ea8cc0de) 00000020:00000080:3.0:1787707137.219439:0:5837:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787707137.236800:0:5837:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787707137.237307:0:5837:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787707137.259272:0:5837:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787707137.259316:0:5837:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787707137.259336:0:5837:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787707137.259422:0:5837:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787707137.259447:0:5837:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787707137.259997:0:5837:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787707137.260006:0:5837:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787707137.260018:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f18d5f94ec05e8 00000020:01000004:2.0:1787707137.260027:0:5837:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787707137.260033:0:5837:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787707137.260038:0:5837:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000057e7f6fe from MGS 00000020:01000004:2.0:1787707137.260042:0:5837:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787707137.260071:0:5837:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000ff47d5e6) 00000020:00000080:2.0:1787707137.260085:0:5837:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787707137.260164:0:5837:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000057e7f6fe from MGS, refs=2 00080000:01000000:2.0:1787707137.260171:0:5837:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787707137.260176:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f18d5f94ec05f6 00000100:00100000:2.0:1787707137.260281:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787707137.260527:0:5837:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787707137.260534:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787707137.261298:0:5837:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787707137.261306:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787707137.262116:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787707137.262281:0:5837:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787707137.262286:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787707137.262997:0:5837:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787707137.263003:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787707137.263291:0:5837:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787707137.263296:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787707137.264018:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707137.264023:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707137.264025:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707137.264256:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707137.264258:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707137.264259:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707137.264862:0:5837:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787707137.270066:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787707137.514730:0:5837:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4947 MB/s 00000001:01000000:0.0:1787707137.764542:0:5837:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4015 MB/s 00000001:01000000:0.0:1787707138.014536:0:5837:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 751 MB/s 00000001:01000000:2.0:1787707138.265771:0:5837:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1087 MB/s 00080000:10000000:2.0:1787707138.272149:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1787707138.294346:0:5837:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787707138.294362:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787707138.294365:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787707138.295003:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787707138.295052:0:5837:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787707138.295087:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787707138.295234:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787707138.295258:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787707138.295640:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787707138.295822:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787707138.295829:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:3.0:1787707138.298149:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707138.298254:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787707138.298266:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787707138.298767:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787707138.298774:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787707138.302867:0:5837:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787707138.302895:0:5837:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.146@tcp' 00000020:01000004:2.0:1787707138.302897:0:5837:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787707138.302963:0:5837:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.146@tcp (typ=mgc) 00000020:00000080:2.0:1787707138.302977:0:5837:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.146@tcp (00000000295ecc55) 00000020:00000080:2.0:1787707138.302995:0:5837:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787707138.303091:0:5837:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006c52bd3d@MGC192.168.204.146@tcp: add connection 192.168.204.146@tcp at head 00010000:00010000:2.0:1787707138.303329:0:5837:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.146@tcp-0 is initialized 00000040:01000000:2.0:1787707138.303335:0:5837:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.146@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787707138.303671:0:5853:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787707138.303703:0:5837:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.146@tcp (uuid 5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d) 00000020:00000080:2.0:1787707138.303718:0:5837:0:(genops.c:1385:class_connect()) connect: client 5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d, cookie 0xc5f18d5f94ec0604 00000100:00080000:2.0:1787707138.303727:0:5837:0:(import.c:510:import_select_connection()) MGC192.168.204.146@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787707138.303732:0:5837:0:(import.c:624:import_select_connection()) MGC192.168.204.146@tcp: import 000000006c52bd3d using connection 192.168.204.146@tcp/0@lo 00000100:00100000:2.0:1787707138.303777:0:5837:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c5b3324b x1874546729681024/t0(0) o250->MGC192.168.204.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787707138.303797:0:5837:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d->MGS 00000020:01000004:2.0:1787707138.303816:0:5837:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787707138.303821:0:5837:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787707138.303831:0:5837:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000003bcf60e1) 00000020:00000080:2.0:1787707138.303841:0:5837:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787707138.304414:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c5b3324b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3313:1874546729681024:0@lo:250: 00000100:00100000:0.0:1787707138.304509:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707138.304603:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729681024 00000100:00100000:0.0:1787707138.304612:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729681024 00000100:00100000:0.0:1787707138.304661:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787707138.304669:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cca089b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3313:x1874546729681024:12345-0@lo:250: 00010000:00080000:0.0:1787707138.304693:0:5848:0:(ldlm_lib.c:1455:target_handle_connect()) MGS: connection from 5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:0.0:1787707138.304719:0:5848:0:(genops.c:1385:class_connect()) connect: client 5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d, cookie 0xc5f18d5f94ec0612 00000100:00080000:0.0:1787707138.304842:0:5848:0:(import.c:65:import_set_state_nolock()) 00000000059e15e8 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787707138.304894:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cca089b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+5:3313:x1874546729681024:12345-0@lo:250: Request processed in 225us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707138.304901:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787707138.304956:0:3313:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.146@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787707138.304964:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.146@tcp: connect to target with instance 0 00000100:00080000:0.0:1787707138.304971:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.146@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787707138.304975:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787707138.304978:0:3313:0:(import.c:65:import_set_state_nolock()) 000000006c52bd3d MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787707138.304980:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787707138.304983:0:3313:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787707138.304988:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c5b3324b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3313:1874546729681024:0@lo:250: 00000100:00080000:3.0:1787707138.312546:0:5852:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1787707138.331570:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787707138.331768:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787707138.331775:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787707138.336074:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787707138.336089:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787707138.336773:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787707138.336789:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787707138.338603:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787707138.338796:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787707138.338802:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787707138.339864:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787707138.339874:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787707138.391275:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787707138.391800:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787707138.391806:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787707138.394130:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787707138.394144:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787707138.395706:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787707138.396059:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787707138.396065:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787707138.397034:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787707138.397043:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787707138.398140:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787707138.398707:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787707138.398713:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787707138.399674:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787707138.399683:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787707138.400758:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787707138.401085:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787707138.401091:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787707138.402113:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787707138.402121:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787707138.433771:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787707138.434239:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787707138.434247:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787707138.436255:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787707138.436269:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787707138.439518:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787707138.439535:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787707138.440751:0:5837:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787707138.440777:0:5837:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787707138.440784:0:5837:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.146@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787707138.441092:0:5837:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.146@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787707138.441126:0:5837:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.146@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787707138.441131:0:5837:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787707138.441133:0:5837:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787707138.441134:0:5837:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787707138.441135:0:5837:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787707138.441137:0:5837:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787707138.441138:0:5837:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787707138.441139:0:5837:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787707138.441141:0:5837:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787707138.441142:0:5837:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787707138.441143:0:5837:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787707138.441145:0:5837:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787707138.441146:0:5837:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787707138.441223:0:5837:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787707138.441227:0:5837:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787707138.441228:0:5837:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787707138.441229:0:5837:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787707138.441231:0:5837:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787707138.441232:0:5837:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787707138.441233:0:5837:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787707138.441234:0:5837:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787707138.441235:0:5837:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787707138.441236:0:5837:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787707138.441237:0:5837:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787707138.441238:0:5837:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787707138.441239:0:5837:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787707138.441278:0:5837:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787707138.441296:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000086228de pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729681152:0@lo:253: 00000100:00100000:2.0:1787707138.441736:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707138.441920:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000509b0766 going to sleep for 11 seconds 00000100:00100000:3.0:1787707138.442064:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729681152 00000100:00100000:3.0:1787707138.442073:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729681152 00000100:00100000:3.0:1787707138.442170:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787707138.442180:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029a80782 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+5:5837:x1874546729681152:12345-0@lo:253: 20000000:01000000:3.0:1787707138.442229:0:5851:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787707138.442232:0:5851:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1787707138.442787:0:5872:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787707138.442925:0:5851:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1787707138.443472:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787707138.445114:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1787707138.450919:0:5851:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787707138.450927:0:5851:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1787707138.451012:0:5851:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1787707138.451015:0:5851:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1787707138.451039:0:5851:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1787707138.451672:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787707138.452161:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1787707138.452176:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787707138.452226:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1787707138.452279:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1787707138.452333:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1787707138.452468:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1787707138.452477:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1787707138.452522:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1787707138.452529:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1787707138.452561:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1787707138.452568:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1787707138.452611:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1787707138.452662:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1787707138.452694:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787707138.452699:0:5851:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1787707138.452710:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787707138.453274:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1787707138.453287:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787707138.453441:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1787707138.453478:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1787707138.453525:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1787707138.453537:0:5851:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1787707138.453734:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1787707138.453744:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787707138.453787:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1787707138.453921:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1787707138.454044:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1787707138.454056:0:5851:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1787707138.454141:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1787707138.454271:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787707138.454406:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787707138.454446:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787707138.454700:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787707138.454750:0:5851:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787707138.454758:0:5851:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787707138.455798:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787707138.456489:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787707138.456516:0:5851:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.146@tcp for mdt 20000000:01000000:2.0:1787707138.456518:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.146@tcp (null) (null) (null) 00000040:00080000:2.0:1787707138.456555:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787707138.456563:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787707138.456667:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787707138.456679:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.146@tcp (null) (null) 00000040:00080000:2.0:1787707138.456728:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787707138.456739:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787707138.456770:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787707138.456803:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787707138.457029:0:5851:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787707138.457033:0:5851:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787707138.457037:0:5851:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787707138.457049:0:5851:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787707138.457052:0:5851:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787707138.457081:0:5851:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787707138.457083:0:5851:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787707138.458015:0:5875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787707138.458510:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787707138.458560:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787707138.458664:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1787707138.458687:0:5851:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787707138.458689:0:5851:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787707138.462261:0:5876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1787707138.463052:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787707138.463100:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1787707138.463272:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1787707138.463288:0:5851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787707138.463290:0:5851:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1787707138.463295:0:5851:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787707138.463298:0:5851:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787707138.463513:0:5851:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787707138.463520:0:5851:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787707138.464270:0:5877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1787707138.464772:0:5851:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787707138.476056:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1787707138.476115:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1787707138.476295:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1787707138.476704:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787707138.476726:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002b4e134b/0xc5f18d5f94ec0619 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707138.476742:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b4e134b/0xc5f18d5f94ec0619 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707138.476752:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002b4e134b/0xc5f18d5f94ec0619 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707138.476759:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002b4e134b/0xc5f18d5f94ec0619 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707138.476766:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002b4e134b/0xc5f18d5f94ec0619 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707138.476784:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002b4e134b/0xc5f18d5f94ec0619 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707138.476790:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002b4e134b already unused, calling callback (0000000023854d45) 00010000:00010000:2.0:1787707138.476794:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002b4e134b/0xc5f18d5f94ec0619 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707138.476801:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002b4e134b/0xc5f18d5f94ec0619 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707138.476826:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002b4e134b/0xc5f18d5f94ec0619 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707138.476907:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002b4e134b/0xc5f18d5f94ec0619 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707138.476912:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002b4e134b/0xc5f18d5f94ec0619 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787707138.477009:0:5851:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787707138.700763:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029a80782 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+5:5837:x1874546729681152:12345-0@lo:253: Request processed in 258573us (259016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707138.700785:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787707138.700969:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000086228de pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729681152:0@lo:253: 10000000:01000000:3.0:1787707138.700986:0:5837:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787707138.700988:0:5837:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787707138.700990:0:5837:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787707138.700991:0:5837:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787707138.700993:0:5837:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787707138.700994:0:5837:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787707138.701010:0:5837:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787707138.701011:0:5837:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787707138.701013:0:5837:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787707138.701014:0:5837:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787707138.701016:0:5837:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787707138.701017:0:5837:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787707138.701036:0:5837:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000057e7f6fe from lustre-MDT0000 10000000:01000000:3.0:1787707138.701081:0:5837:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787707138.701085:0:5837:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787707138.701089:0:5837:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cfa05848000 10000000:01000000:3.0:1787707138.701094:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787707138.701104:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cfa05848000 from 1 10000000:01000000:3.0:1787707138.701107:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787707138.701156:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: 0000000050aa7ec1/0xc5f18d5f94ec0620 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707138.701166:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: 0000000050aa7ec1/0xc5f18d5f94ec0620 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707138.701175:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: 0000000050aa7ec1/0xc5f18d5f94ec0620 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707138.701192:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000530cd4fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729681280:0@lo:101: 00000100:00100000:3.0:1787707138.701249:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707138.701346:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000420b022f going to sleep for 11 seconds 00000100:00100000:0.0:1787707138.701422:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729681280 00000100:00100000:0.0:1787707138.701430:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729681280 00000100:00100000:0.0:1787707138.701471:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787707138.701479:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067aa0446 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+5:5837:x1874546729681280:12345-0@lo:101: 00010000:00010000:0.0:1787707138.701492:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707138.701506:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007c4d8885/0xc5f18d5f94ec0627 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0620 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707138.701530:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007c4d8885/0xc5f18d5f94ec0627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0620 expref: 6 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707138.701541:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007c4d8885/0xc5f18d5f94ec0627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0620 expref: 6 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707138.701549:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007c4d8885, rc 0) 00000100:00100000:0.0:1787707138.701590:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067aa0446 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+6:5837:x1874546729681280:12345-0@lo:101: Request processed in 112us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707138.701597:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787707138.701676:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000530cd4fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729681280:0@lo:101: 00010000:00010000:3.0:1787707138.701689:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: 0000000050aa7ec1/0xc5f18d5f94ec0620 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0627 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707138.701697:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: 0000000050aa7ec1/0xc5f18d5f94ec0620 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0627 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707138.701755:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000530cd4fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729681408:0@lo:501: 00000100:00100000:3.0:1787707138.701780:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707138.701985:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729681408 00000100:00100000:0.0:1787707138.701989:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729681408 00000100:00100000:0.0:1787707138.702015:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787707138.702020:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000921868b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+6:5837:x1874546729681408:12345-0@lo:501: 00000100:00100000:0.0:1787707138.702273:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000921868b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+6:5837:x1874546729681408:12345-0@lo:501: Request processed in 253us (492us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787707138.702281:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787707138.702606:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000420b022f going to sleep for 11 seconds 00000100:00100000:0.0:1787707138.702626:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000530cd4fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729681408:0@lo:501: 10000000:01000000:0.0:1787707138.702656:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787707138.702710:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: 0000000050aa7ec1/0xc5f18d5f94ec0620 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0627 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707138.702719:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: 0000000050aa7ec1/0xc5f18d5f94ec0620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0627 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707138.702728:0:5837:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cfa02b55800 10000000:01000000:0.0:1787707138.702733:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787707138.702738:0:5837:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cfa02b55800 10000000:01000000:0.0:1787707138.702740:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787707138.702742:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cfa02b55800 from 1 10000000:01000000:0.0:1787707138.702744:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787707138.702779:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: 00000000d91c13b5/0xc5f18d5f94ec062e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707138.702785:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: 00000000d91c13b5/0xc5f18d5f94ec062e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707138.702793:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: 00000000d91c13b5/0xc5f18d5f94ec062e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707138.702900:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000164867c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729681536:0@lo:101: 00000100:00100000:0.0:1787707138.702946:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707138.703008:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 000000008c8f193d going to sleep for 11 seconds 00000100:00100000:1.0:1787707138.703053:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729681536 00000100:00100000:1.0:1787707138.703061:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729681536 00000100:00100000:1.0:1787707138.703149:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787707138.703157:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b68e17e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+6:5837:x1874546729681536:12345-0@lo:101: 00010000:00010000:1.0:1787707138.703168:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707138.703180:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000016891d89/0xc5f18d5f94ec0635 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec062e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707138.703201:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000016891d89/0xc5f18d5f94ec0635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec062e expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707138.703211:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000016891d89/0xc5f18d5f94ec0635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec062e expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707138.703219:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000016891d89, rc 0) 00000100:00100000:1.0:1787707138.703306:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b68e17e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+7:5837:x1874546729681536:12345-0@lo:101: Request processed in 151us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707138.703313:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787707138.703412:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000164867c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729681536:0@lo:101: 00010000:00010000:2.0:1787707138.703425:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: 00000000d91c13b5/0xc5f18d5f94ec062e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0635 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707138.703432:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: 00000000d91c13b5/0xc5f18d5f94ec062e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0635 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707138.703444:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787707138.703459:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: 00000000d91c13b5/0xc5f18d5f94ec062e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0635 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707138.703472:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: 00000000d91c13b5/0xc5f18d5f94ec062e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0635 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707138.703479:0:5837:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787707138.703483:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787707138.703488:0:5837:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cfa02b55800 10000000:01000000:2.0:1787707138.703491:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787707138.703493:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787707138.703496:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787707138.703512:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: 000000002b4e134b/0xc5f18d5f94ec063c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707138.703519:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: 000000002b4e134b/0xc5f18d5f94ec063c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707138.703524:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: 000000002b4e134b/0xc5f18d5f94ec063c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707138.703538:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a248333 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729681664:0@lo:101: 00000100:00100000:2.0:1787707138.703576:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707138.703605:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a53171bf going to sleep for 11 seconds 00000100:00100000:0.0:1787707138.703658:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729681664 00000100:00100000:0.0:1787707138.703663:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729681664 00000100:00100000:0.0:1787707138.703694:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787707138.703707:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020923b08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+7:5837:x1874546729681664:12345-0@lo:101: 00010000:00010000:0.0:1787707138.703714:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707138.703720:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b970134d/0xc5f18d5f94ec0643 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec063c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707138.703733:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b970134d/0xc5f18d5f94ec0643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec063c expref: 8 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707138.703742:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b970134d/0xc5f18d5f94ec0643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec063c expref: 8 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707138.703748:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b970134d, rc 0) 00000100:00100000:0.0:1787707138.703775:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020923b08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+8:5837:x1874546729681664:12345-0@lo:101: Request processed in 70us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707138.703781:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787707138.703941:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a248333 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729681664:0@lo:101: 00010000:00010000:2.0:1787707138.703951:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: 000000002b4e134b/0xc5f18d5f94ec063c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0643 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707138.703958:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: 000000002b4e134b/0xc5f18d5f94ec063c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0643 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707138.704019:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a248333 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729681792:0@lo:501: 00000100:00100000:2.0:1787707138.704043:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707138.704064:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a53171bf going to sleep for 11 seconds 00000100:00100000:0.0:1787707138.704115:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729681792 00000100:00100000:0.0:1787707138.704120:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729681792 00000100:00100000:0.0:1787707138.704151:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787707138.704156:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007bdb7c30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+8:5837:x1874546729681792:12345-0@lo:501: 00000100:00100000:0.0:1787707138.704396:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007bdb7c30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+9:5837:x1874546729681792:12345-0@lo:501: Request processed in 239us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707138.704403:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787707138.704482:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a248333 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729681792:0@lo:501: 00000100:00100000:2.0:1787707138.704509:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a248333 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729681920:0@lo:503: 00000100:00100000:2.0:1787707138.704545:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707138.704574:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a53171bf going to sleep for 11 seconds 00000100:00100000:0.0:1787707138.704677:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729681920 00000100:00100000:0.0:1787707138.704682:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729681920 00000100:00100000:0.0:1787707138.704711:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787707138.704716:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ff0a375 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+9:5837:x1874546729681920:12345-0@lo:503: 00000100:00100000:0.0:1787707138.705043:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ff0a375 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+9:5837:x1874546729681920:12345-0@lo:503: Request processed in 327us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707138.705060:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787707138.705177:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a248333 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729681920:0@lo:503: 00000100:00100000:1.0:1787707138.705684:0:5880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ee5c1d1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5880:1874546729682048:0@lo:502: 00000100:00100000:1.0:1787707138.705727:0:5880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707138.705795:0:5880:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e0d5972 going to sleep for 11 seconds 00000100:00100000:2.0:1787707138.705906:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729682048 00000100:00100000:2.0:1787707138.705912:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729682048 00000100:00100000:2.0:1787707138.705995:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787707138.706003:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3fdfefe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+9:5880:x1874546729682048:12345-0@lo:502: 00000100:00100000:2.0:1787707138.706209:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3fdfefe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+9:5880:x1874546729682048:12345-0@lo:502: Request processed in 207us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707138.706216:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787707138.706284:0:5880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ee5c1d1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5880:1874546729682048:0@lo:502: 00000020:01000000:1.0:1787707138.706308:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787707138.706319:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707138.706321:0:5880:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787707138.706326:0:5880:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787707138.706329:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787707138.706349:0:5880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000009c1caca4) 00000020:00000080:1.0:1787707138.706403:0:5880:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787707138.706412:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787707138.706523:0:5880:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787707138.706530:0:5880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f18d5f94ec0651 00000020:00000080:1.0:1787707138.706741:0:5880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787707138.706746:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787707138.706749:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707138.706750:0:5880:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787707138.706753:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787707138.706756:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707138.706758:0:5880:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787707138.706761:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787707138.706766:0:5880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000cf59b506) 00000020:00000080:1.0:1787707138.706775:0:5880:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787707138.706779:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787707138.706780:0:5880:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787707138.706783:0:5880:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787707138.706788:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787707138.706910:0:5880:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000057e7f6fe from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787707138.706922:0:5880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000048fd8c28) 00000020:00000080:1.0:1787707138.706943:0:5880:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787707138.707021:0:5880:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787707138.707027:0:5880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f18d5f94ec0666 00000020:00000080:1.0:1787707138.707118:0:5880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787707138.707125:0:5880:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787707138.707129:0:5880:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc5f18d5f94ec066d 00080000:01000000:1.0:1787707138.707134:0:5880:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787707138.707137:0:5880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f18d5f94ec0674 00080000:10000000:1.0:1787707138.707590:0:5880:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1787707138.707801:0:5880:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787707138.713349:0:5880:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1787707138.789618:0:5880:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1787707138.790139:0:5880:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1787707138.793087:0:5880:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1787707138.793518:0:5880:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787707138.833348:0:5880:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000e47b3908) 00000020:00000080:0.0:1787707138.833412:0:5880:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787707138.833480:0:5880:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787707138.833487:0:5880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f18d5f94ec0682 00000020:00000080:3.0:1787707138.847293:0:5880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787707138.854256:0:5880:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787707138.888874:0:5880:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787707138.926748:0:5880:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787707138.979909:0:5880:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787707139.052193:0:5880:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787707139.100855:0:5880:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1787707139.129623:0:5880:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc5f18d5f94ec0689 00000020:00000080:3.0:1787707139.130205:0:5880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787707139.130217:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787707139.130225:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787707139.130228:0:5880:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787707139.130231:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787707139.130235:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787707139.130236:0:5880:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787707139.130238:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787707139.130240:0:5880:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787707139.130243:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787707139.130245:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787707139.130246:0:5880:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787707139.130248:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787707139.130253:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787707139.130254:0:5880:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787707139.130259:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787707139.130303:0:5880:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1787707139.130391:0:5880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a9912ed7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5880:1874546729682176:0@lo:502: 00000100:00100000:3.0:1787707139.130596:0:5880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707139.130747:0:5880:0:(client.c:2715:ptlrpc_set_wait()) set 0000000029c53a1b going to sleep for 11 seconds 00000100:00100000:0.0:1787707139.130889:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729682176 00000100:00100000:0.0:1787707139.130897:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729682176 00000100:00100000:0.0:1787707139.130988:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787707139.130999:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001be521b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+9:5880:x1874546729682176:12345-0@lo:502: 00000100:00100000:0.0:1787707139.131365:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001be521b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+9:5880:x1874546729682176:12345-0@lo:502: Request processed in 367us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707139.131401:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787707139.131571:0:5880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a9912ed7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5880:1874546729682176:0@lo:502: 00000020:01000000:3.0:1787707139.131616:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787707139.131623:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787707139.131625:0:5880:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1787707139.131629:0:5880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787707139.131822:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787707139.131845:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787707139.131864:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: 000000002b4e134b/0xc5f18d5f94ec063c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0643 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707139.131875:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: 000000002b4e134b/0xc5f18d5f94ec063c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0643 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707139.131894:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfa02b55800 from 1 10000000:01000000:2.0:1787707139.131897:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787707139.131940:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: 0000000025a7b165/0xc5f18d5f94ec0690 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707139.131948:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: 0000000025a7b165/0xc5f18d5f94ec0690 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707139.131956:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: 0000000025a7b165/0xc5f18d5f94ec0690 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707139.131972:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003fc3308a pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729682304:0@lo:101: 00000100:00100000:2.0:1787707139.132011:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707139.132345:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b1132d9d going to sleep for 11 seconds 00000100:00100000:1.0:1787707139.132664:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729682304 00000100:00100000:1.0:1787707139.132677:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729682304 00000100:00100000:1.0:1787707139.132715:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787707139.132723:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000124ed9e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+9:5837:x1874546729682304:12345-0@lo:101: 00010000:00010000:1.0:1787707139.132742:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707139.132758:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007cd0bcac/0xc5f18d5f94ec0697 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0690 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.132786:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007cd0bcac/0xc5f18d5f94ec0697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0690 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.132807:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007cd0bcac/0xc5f18d5f94ec0697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0690 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.132816:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007cd0bcac, rc 0) 00000100:00100000:1.0:1787707139.132864:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000124ed9e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+10:5837:x1874546729682304:12345-0@lo:101: Request processed in 141us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707139.132871:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787707139.133043:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003fc3308a pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729682304:0@lo:101: 00010000:00010000:3.0:1787707139.133058:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: 0000000025a7b165/0xc5f18d5f94ec0690 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0697 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707139.133066:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: 0000000025a7b165/0xc5f18d5f94ec0690 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0697 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707139.133705:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a9912ed7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729682432:0@lo:256: 00000100:00100000:3.0:1787707139.133754:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707139.133781:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 0000000029c53a1b going to sleep for 11 seconds 00000100:00100000:0.0:1787707139.133977:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729682432 00000100:00100000:0.0:1787707139.133984:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729682432 00000100:00100000:2.0:1787707139.134201:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787707139.134209:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4eea3c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+10:5837:x1874546729682432:12345-0@lo:256: 20000000:01000000:2.0:1787707139.134229:0:5851:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787707139.134236:0:5851:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787707139.134310:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4eea3c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+10:5837:x1874546729682432:12345-0@lo:256: Request processed in 102us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707139.134318:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787707139.134410:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a9912ed7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729682432:0@lo:256: 10000000:01000000:3.0:1787707139.135266:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787707139.135295:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: 0000000025a7b165/0xc5f18d5f94ec0690 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0697 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707139.135306:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: 0000000025a7b165/0xc5f18d5f94ec0690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0697 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787707139.135314:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfa02b55800 from 1 10000000:01000000:3.0:1787707139.135316:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787707139.135351:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: 000000009c37343c/0xc5f18d5f94ec069e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707139.135358:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: 000000009c37343c/0xc5f18d5f94ec069e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707139.135406:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: 000000009c37343c/0xc5f18d5f94ec069e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707139.135426:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a9912ed7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729682560:0@lo:101: 00000100:00100000:3.0:1787707139.135592:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707139.135752:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 0000000029c53a1b going to sleep for 11 seconds 00000100:00100000:1.0:1787707139.136009:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729682560 00000100:00100000:1.0:1787707139.136019:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729682560 00000100:00100000:1.0:1787707139.136062:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787707139.136069:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ea4760a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+10:5837:x1874546729682560:12345-0@lo:101: 00010000:00010000:1.0:1787707139.136082:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707139.136096:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000055ecb2f1/0xc5f18d5f94ec06a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec069e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.136117:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000055ecb2f1/0xc5f18d5f94ec06a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec069e expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.136125:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000055ecb2f1/0xc5f18d5f94ec06a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec069e expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.136133:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000055ecb2f1, rc 0) 00000100:00100000:1.0:1787707139.136215:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ea4760a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:5837:x1874546729682560:12345-0@lo:101: Request processed in 146us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707139.136222:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787707139.136286:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a9912ed7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729682560:0@lo:101: 00010000:00010000:3.0:1787707139.136298:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: 000000009c37343c/0xc5f18d5f94ec069e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec06a5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707139.136306:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: 000000009c37343c/0xc5f18d5f94ec069e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec06a5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707139.136353:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a9912ed7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729682688:0@lo:501: 00000100:00100000:3.0:1787707139.136405:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707139.136419:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 0000000029c53a1b going to sleep for 11 seconds 00000100:00100000:1.0:1787707139.136467:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729682688 00000100:00100000:1.0:1787707139.136471:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729682688 00000100:00100000:1.0:1787707139.136485:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787707139.136490:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019266db1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:5837:x1874546729682688:12345-0@lo:501: 00000100:00100000:1.0:1787707139.137144:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019266db1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:5837:x1874546729682688:12345-0@lo:501: Request processed in 652us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707139.137152:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787707139.137250:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a9912ed7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729682688:0@lo:501: 00000100:00100000:3.0:1787707139.137281:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a9912ed7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729682816:0@lo:503: 00000100:00100000:3.0:1787707139.137314:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707139.137335:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 0000000029c53a1b going to sleep for 11 seconds 00000100:00100000:1.0:1787707139.137401:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729682816 00000100:00100000:1.0:1787707139.137406:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729682816 00000100:00100000:1.0:1787707139.137423:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787707139.137428:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064affd5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:5837:x1874546729682816:12345-0@lo:503: 00000040:00080000:1.0:1787707139.137566:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787707139.137609:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064affd5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:5837:x1874546729682816:12345-0@lo:503: Request processed in 181us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707139.137615:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787707139.137677:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a9912ed7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729682816:0@lo:503: 00000040:00080000:3.0:1787707139.138558:0:5884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1787707139.138942:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787707139.138960:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787707139.138981:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: 000000009c37343c/0xc5f18d5f94ec069e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec06a5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.138993:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: 000000009c37343c/0xc5f18d5f94ec069e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec06a5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707139.139034:0:5837:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787707139.139037:0:5837:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cfa02b55800 10000000:01000000:1.0:1787707139.139040:0:5837:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cfa02b55800 10000000:01000000:1.0:1787707139.139044:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787707139.139049:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfa02b55800 from 1 10000000:01000000:1.0:1787707139.139051:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787707139.139084:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: 0000000031dece36/0xc5f18d5f94ec06ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.139092:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: 0000000031dece36/0xc5f18d5f94ec06ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.139101:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: 0000000031dece36/0xc5f18d5f94ec06ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707139.139121:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ee5c1d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729682944:0@lo:101: 00000100:00100000:1.0:1787707139.139169:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707139.139207:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000953cb0c1 going to sleep for 11 seconds 00000100:00100000:2.0:1787707139.139299:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729682944 00000100:00100000:2.0:1787707139.139306:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729682944 00000100:00100000:2.0:1787707139.139347:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787707139.139355:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005806b28e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:5837:x1874546729682944:12345-0@lo:101: 00010000:00010000:2.0:1787707139.139367:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707139.139414:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cb9abd8b/0xc5f18d5f94ec06b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec06ac expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707139.139517:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb9abd8b/0xc5f18d5f94ec06b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec06ac expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707139.139527:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cb9abd8b/0xc5f18d5f94ec06b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec06ac expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707139.139534:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cb9abd8b, rc 0) 00000100:00100000:2.0:1787707139.139572:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005806b28e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:5837:x1874546729682944:12345-0@lo:101: Request processed in 217us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707139.139577:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787707139.139682:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ee5c1d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729682944:0@lo:101: 00010000:00010000:3.0:1787707139.139695:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: 0000000031dece36/0xc5f18d5f94ec06ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec06b3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707139.139710:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: 0000000031dece36/0xc5f18d5f94ec06ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec06b3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707139.139756:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a9912ed7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729683072:0@lo:501: 00000100:00100000:3.0:1787707139.139783:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707139.139875:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000636f5f02 going to sleep for 11 seconds 00000100:00100000:2.0:1787707139.139929:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729683072 00000100:00100000:2.0:1787707139.139933:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729683072 00000100:00100000:2.0:1787707139.139950:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787707139.139955:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4a222f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:5837:x1874546729683072:12345-0@lo:501: 00000100:00100000:2.0:1787707139.140221:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4a222f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:5837:x1874546729683072:12345-0@lo:501: Request processed in 265us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707139.140228:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787707139.140293:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a9912ed7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729683072:0@lo:501: 00000100:00100000:3.0:1787707139.140320:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a9912ed7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729683200:0@lo:503: 00000100:00100000:3.0:1787707139.140358:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707139.140410:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000636f5f02 going to sleep for 11 seconds 00000100:00100000:1.0:1787707139.140541:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729683200 00000100:00100000:1.0:1787707139.140551:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729683200 00000100:00100000:1.0:1787707139.140572:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787707139.140578:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ab5096e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:5837:x1874546729683200:12345-0@lo:503: 00000100:00100000:1.0:1787707139.141108:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ab5096e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:5837:x1874546729683200:12345-0@lo:503: Request processed in 529us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707139.141117:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787707139.141331:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a9912ed7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729683200:0@lo:503: 00000100:00100000:0.0:1787707139.141964:0:5885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007025dcc2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5885:1874546729683328:0@lo:502: 00000100:00100000:0.0:1787707139.142021:0:5885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707139.142094:0:5885:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f464b064 going to sleep for 11 seconds 00000100:00100000:2.0:1787707139.142134:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729683328 00000100:00100000:2.0:1787707139.142140:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729683328 00000100:00100000:2.0:1787707139.142180:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787707139.142187:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088b7058f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:5885:x1874546729683328:12345-0@lo:502: 00000100:00100000:2.0:1787707139.142692:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088b7058f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:5885:x1874546729683328:12345-0@lo:502: Request processed in 505us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707139.142701:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787707139.142770:0:5885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007025dcc2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5885:1874546729683328:0@lo:502: 00000020:01000004:0.0:1787707139.142902:0:5885:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787707139.142931:0:5885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000005f5c77eb) 00000020:00000080:0.0:1787707139.142965:0:5885:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787707139.143048:0:5885:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000057e7f6fe from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787707139.143057:0:5885:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000057e7f6fe from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787707139.143060:0:5885:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000057e7f6fe 4 00010000:00080000:0.0:1787707139.143089:0:5885:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c607283f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.146@tcp at head 00010000:00010000:2.0:1787707139.146888:0:5885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787707139.147154:0:5885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787707139.147190:0:5885:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787707139.147207:0:5885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc5f18d5f94ec06c1 00000100:00080000:2.0:1787707139.147217:0:5885:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787707139.147222:0:5885:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c607283f using connection 192.168.204.146@tcp/0@lo 00000100:00100000:2.0:1787707139.147259:0:5885:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009e7f416b x1874546729683456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787707139.147287:0:5885:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787707139.147399:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009e7f416b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874546729683456:0@lo:38: 00000100:00100000:0.0:1787707139.147545:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707139.147673:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729683456 00000100:00100000:2.0:1787707139.147681:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729683456 00000100:00100000:2.0:1787707139.147722:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787707139.147729:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007025dcc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874546729683456:12345-0@lo:38: 00000100:00100000:2.0:1787707139.147805:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007025dcc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874546729683456:12345-0@lo:38: Request processed in 64us (249us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787707139.147813:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787707139.147851:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787707139.147858:0:3313:0:(import.c:65:import_set_state_nolock()) 00000000c607283f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787707139.147862:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787707139.147865:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009e7f416b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874546729683456:0@lo:38: 00000100:00100000:1.0:1787707139.148320:0:5885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001956fc37 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5885:1874546729683584:0@lo:502: 00000100:00100000:1.0:1787707139.148405:0:5885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707139.148428:0:5885:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053f947ed going to sleep for 11 seconds 00000100:00100000:0.0:1787707139.148541:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729683584 00000100:00100000:0.0:1787707139.148546:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729683584 00000100:00100000:0.0:1787707139.148574:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787707139.148579:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bbbcbef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:5885:x1874546729683584:12345-0@lo:502: 00000100:00100000:0.0:1787707139.148778:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bbbcbef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:5885:x1874546729683584:12345-0@lo:502: Request processed in 199us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707139.148786:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787707139.149123:0:5885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001956fc37 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5885:1874546729683584:0@lo:502: 00000040:00080000:1.0:1787707139.149148:0:5885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787707139.149260:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787707139.149276:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787707139.149296:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: 0000000031dece36/0xc5f18d5f94ec06ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec06b3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707139.149306:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: 0000000031dece36/0xc5f18d5f94ec06ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec06b3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787707139.149353:0:5837:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787707139.149355:0:5837:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787707139.149357:0:5837:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787707139.149358:0:5837:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787707139.149363:0:5837:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787707139.149365:0:5837:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787707139.149366:0:5837:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787707139.149397:0:5837:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787707139.149399:0:5837:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787707139.149400:0:5837:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787707139.149401:0:5837:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787707139.149403:0:5837:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787707139.149406:0:5837:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787707139.149408:0:5837:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787707139.149409:0:5837:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787707139.149410:0:5837:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787707139.149411:0:5837:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787707139.149412:0:5837:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787707139.149413:0:5837:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787707139.149414:0:5837:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787707139.149414:0:5837:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787707139.149415:0:5837:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787707139.149416:0:5837:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787707139.149417:0:5837:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787707139.149417:0:5837:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787707139.149434:0:5837:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787707139.149513:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009e7f416b pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729683712:0@lo:253: 00000100:00100000:2.0:1787707139.149555:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707139.149583:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000757b119d going to sleep for 11 seconds 00000100:00100000:1.0:1787707139.149640:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729683712 00000100:00100000:1.0:1787707139.149646:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729683712 00000100:00100000:1.0:1787707139.149686:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787707139.149693:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d9cd6a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:5837:x1874546729683712:12345-0@lo:253: 20000000:01000000:1.0:1787707139.149717:0:5848:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787707139.149731:0:5848:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787707139.185408:0:5848:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787707139.185431:0:5848:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787707139.185761:0:5872:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787707139.185766:0:5872:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787707139.185791:0:5872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c186923d/0xc5f18d5f94ec06c8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.185817:0:5872:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007cd0bcac/0xc5f18d5f94ec0697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0690 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.185824:0:5872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c186923d/0xc5f18d5f94ec06c8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.185866:0:5872:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007cd0bcac/0xc5f18d5f94ec0697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec0690 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.185896:0:5872:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007cd0bcac/0xc5f18d5f94ec0697 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0690 expref: 12 pid: 5848 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707139.185912:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001956fc37 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5872:1874546729683840:0@lo:104: 00000100:00100000:1.0:1787707139.186005:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707139.186070:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061e12b0d going to sleep for 11 seconds 00000100:00100000:2.0:1787707139.186284:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729683840 00000100:00100000:2.0:1787707139.186292:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729683840 00000100:00100000:2.0:1787707139.186340:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787707139.186349:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067e96f4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:5872:x1874546729683840:12345-0@lo:104: 00010000:00010000:2.0:1787707139.186363:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: 0000000025a7b165/0xc5f18d5f94ec0690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0697 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707139.186512:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787707139.186517:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067e96f4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:5872:x1874546729683840:12345-0@lo:104: Request processed in 171us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707139.186531:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787707139.186599:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787707139.186605:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: 0000000025a7b165/0xc5f18d5f94ec0690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0697 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.186612:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000025a7b165 already unused, calling callback (00000000a2afe9b6) 10000000:00010000:1.0:1787707139.186615:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: 0000000025a7b165/0xc5f18d5f94ec0690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec0697 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.186622:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: 0000000025a7b165/0xc5f18d5f94ec0690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec0697 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787707139.186629:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: 0000000025a7b165/0xc5f18d5f94ec0690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec0697 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707139.186634:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787707139.186675:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: 0000000025a7b165/0xc5f18d5f94ec0690 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0697 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.186682:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787707139.186701:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: 0000000025a7b165/0xc5f18d5f94ec0690 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0697 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.186707:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: 0000000025a7b165/0xc5f18d5f94ec0690 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0697 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.186733:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707139.186735:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707139.186736:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707139.186806:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000298b334f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729683968:0@lo:103: 00000100:00100000:1.0:1787707139.186837:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707139.186906:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729683968 00000100:00100000:1.0:1787707139.186911:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729683968 00010000:00010000:1.0:1787707139.186940:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007cd0bcac/0xc5f18d5f94ec0697 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0690 expref: 13 pid: 5848 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707139.186961:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787707139.186967:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009972b73 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:3315:x1874546729683968:12345-0@lo:103: 00010000:00010000:1.0:1787707139.186978:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707139.186983:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007cd0bcac/0xc5f18d5f94ec0697 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0690 expref: 13 pid: 5848 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.186992:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007cd0bcac/0xc5f18d5f94ec0697 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0690 expref: 13 pid: 5848 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.187007:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c186923d/0xc5f18d5f94ec06c8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.187013:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c186923d/0xc5f18d5f94ec06c8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787707139.187026:0:5841:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001260904s 00010000:00010000:1.0:1787707139.187029:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c186923d/0xc5f18d5f94ec06c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.187045:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c186923d/0xc5f18d5f94ec06c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.187050:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c186923d/0xc5f18d5f94ec06c8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.187055:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c186923d/0xc5f18d5f94ec06c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.187059:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c186923d already unused, calling callback (0000000023854d45) 00010000:00010000:1.0:1787707139.187062:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c186923d/0xc5f18d5f94ec06c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.187068:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c186923d/0xc5f18d5f94ec06c8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.187075:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c186923d/0xc5f18d5f94ec06c8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.187084:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707139.187111:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009972b73 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:3315:x1874546729683968:12345-0@lo:103: Request processed in 145us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707139.187117:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787707139.187185:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000298b334f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729683968:0@lo:103: 00010000:00010000:1.0:1787707139.187210:0:5872:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007cd0bcac/0xc5f18d5f94ec0697 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec0690 expref: 12 pid: 5848 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707139.187221:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001956fc37 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5872:1874546729683840:0@lo:104: 00010000:00010000:1.0:1787707139.187231:0:5872:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c186923d/0xc5f18d5f94ec06c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.187243:0:5872:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c186923d/0xc5f18d5f94ec06c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.187249:0:5872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c186923d/0xc5f18d5f94ec06c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707139.187253:0:5872:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c186923d/0xc5f18d5f94ec06c8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707139.194399:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d9cd6a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:5837:x1874546729683712:12345-0@lo:253: Request processed in 44666us (44803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707139.194419:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787707139.194552:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009e7f416b pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5837:1874546729683712:0@lo:253: 10000000:01000000:2.0:1787707139.194570:0:5837:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787707139.194573:0:5837:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787707139.194575:0:5837:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787707139.194576:0:5837:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787707139.194577:0:5837:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787707139.194579:0:5837:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787707139.194580:0:5837:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787707139.194581:0:5837:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787707139.194582:0:5837:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787707139.194583:0:5837:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787707139.194585:0:5837:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787707139.194587:0:5837:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787707139.194588:0:5837:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787707139.194602:0:5837:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787707139.200732:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787707139.201171:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787707139.201422:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787707139.201892:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787707139.202565:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787707139.202757:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787707139.203695:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787707139.204014:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787707139.204190:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787707139.204346:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787707139.204626:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787707139.204907:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787707139.236912:0:5837:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787707139.266931:0:5837:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787707139.267220:0:5891:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787707139.274252:0:5837:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787707139.275037:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1787707139.275094:0:5890:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1787707139.275099:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00000080:0.0:1787707139.275613:0:5837:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787707139.275621:0:5837:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787707139.275977:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787707139.277043:0:5837:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787707139.277637:0:5837:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787707139.277669:0:5837:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787707139.279184:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787707139.280965:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1787707139.284760:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787707139.285149:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787707139.285324:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787707139.286708:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787707139.286884:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787707139.287323:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787707139.287544:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787707139.287688:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787707139.287874:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787707139.288028:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787707139.288174:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787707139.288310:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787707139.288504:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787707139.288641:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787707139.288805:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787707139.288965:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787707139.289270:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787707139.289512:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787707139.289675:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787707139.289829:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787707139.289990:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787707139.290656:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787707139.290841:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787707139.291006:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787707139.291154:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787707139.291283:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787707139.291630:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787707139.291775:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787707139.291970:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787707139.292133:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787707139.292289:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787707139.292647:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787707139.292926:0:5837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1787707139.318975:0:5891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:3.0:1787707139.338056:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787707139.370270:0:5837:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787707139.370314:0:5837:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9ec681db3988 00100000:10000000:2.0:1787707139.370324:0:5837:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787707139.372837:0:5837:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787707139.372855:0:5837:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.146@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787707139.372869:0:5837:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787707139.372893:0:5837:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1787707139.417001:0:5891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787707139.417099:0:5891:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787707139.417104:0:5891:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787707140.347014:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707141.369733:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707142.392554:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707143.416670:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787707143.982895:0:6134:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg446-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787707144.440548:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787707144.504853:0:1375:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787707144.504863:0:1375:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787707144.504866:0:1375:0:(import.c:65:import_set_state_nolock()) 00000000c607283f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787707144.504881:0:1375:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c607283f using connection 192.168.204.146@tcp/0@lo 00000100:00100000:1.0:1787707144.504905:0:1375:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000298b334f x1874546729684224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787707144.504984:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787707144.504997:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001956fc37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729684096:0@lo:400: 00000100:00100000:1.0:1787707144.505066:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707144.505311:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000298b334f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874546729684224:0@lo:38: 00000100:00100000:1.0:1787707144.505349:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707144.505479:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729684096 00000100:00100000:1.0:1787707144.505487:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729684096 00000100:00100000:1.0:1787707144.505531:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787707144.505541:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020494331 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:3317:x1874546729684096:12345-0@lo:400: 00000100:00100000:1.0:1787707144.505591:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020494331 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:3317:x1874546729684096:12345-0@lo:400: Request processed in 51us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707144.505617:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787707144.505675:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001956fc37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729684096:0@lo:400: 00000100:00100000:0.0:1787707144.512872:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729684224 00000100:00100000:0.0:1787707144.512889:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729684224 00000100:00100000:0.0:1787707144.512946:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787707144.512954:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1d5357a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1874546729684224:12345-0@lo:38: 00010000:00080000:0.0:1787707144.512994:0:5858:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:0.0:1787707144.513038:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc5f18d5f94ec06cf 00000004:00100000:0.0:1787707144.513088:0:5858:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787707144.513218:0:5858:0:(import.c:65:import_set_state_nolock()) 000000009ca2dc01 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787707144.513318:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1d5357a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874546729684224:12345-0@lo:38: Request processed in 364us (7967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707144.513326:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787707144.513591:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000298b334f x1874546729684224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787707154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787707144.513608:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787707144.513616:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787707144.513621:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787707144.513623:0:3313:0:(import.c:65:import_set_state_nolock()) 00000000c607283f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787707144.513629:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000298b334f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874546729684224:0@lo:38: 00010000:00010000:0.0:1787707145.464559:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787707145.528470:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787707145.528483:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfa02b55800 from 3 10000000:01000000:2.0:1787707145.528489:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787707145.528534:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: 00000000ad9ce528/0xc5f18d5f94ec06d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707145.528545:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: 00000000ad9ce528/0xc5f18d5f94ec06d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707145.528555:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: 00000000ad9ce528/0xc5f18d5f94ec06d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707145.528579:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009e7f416b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729684352:0@lo:101: 00000100:00100000:2.0:1787707145.528654:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707145.528730:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b1c3475 going to sleep for 11 seconds 00000100:00100000:3.0:1787707145.528926:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729684352 00000100:00100000:3.0:1787707145.528936:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729684352 00000100:00100000:3.0:1787707145.528998:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787707145.529009:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c4994d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:5853:x1874546729684352:12345-0@lo:101: 00010000:00010000:3.0:1787707145.529023:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707145.529041:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e0eb8679/0xc5f18d5f94ec06dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec06d6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707145.529081:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e0eb8679/0xc5f18d5f94ec06dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec06d6 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707145.529091:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e0eb8679/0xc5f18d5f94ec06dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec06d6 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707145.529099:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e0eb8679, rc 0) 00000100:00100000:3.0:1787707145.529146:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c4994d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:5853:x1874546729684352:12345-0@lo:101: Request processed in 139us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707145.529153:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787707145.529203:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009e7f416b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729684352:0@lo:101: 00010000:00010000:3.0:1787707145.529216:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: 00000000ad9ce528/0xc5f18d5f94ec06d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec06dd expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707145.529225:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: 00000000ad9ce528/0xc5f18d5f94ec06d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec06dd expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707145.529281:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a9912ed7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729684480:0@lo:256: 00000100:00100000:3.0:1787707145.529313:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707145.529330:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dc4323ab going to sleep for 11 seconds 00000100:00100000:3.0:1787707145.529345:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729684480 00000100:00100000:3.0:1787707145.529348:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729684480 00000100:00100000:3.0:1787707145.529506:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787707145.529516:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000acee23b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:5853:x1874546729684480:12345-0@lo:256: 20000000:01000000:3.0:1787707145.529536:0:5850:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787707145.529555:0:5850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787707145.529558:0:5850:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787707145.529658:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000acee23b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:5853:x1874546729684480:12345-0@lo:256: Request processed in 144us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707145.530114:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787707145.531213:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a9912ed7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729684480:0@lo:256: 10000000:01000000:1.0:1787707145.531290:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787707145.531301:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: 00000000ad9ce528/0xc5f18d5f94ec06d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec06dd expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707145.531312:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: 00000000ad9ce528/0xc5f18d5f94ec06d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec06dd expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707146.488602:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707147.513012:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707148.540577:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787707149.075024:0:6336:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8f31cb80 20000000:00000080:3.0:1787707149.075046:0:6336:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cfa3b30b000 uarg=0000000000000000 20000000:01000000:3.0:1787707149.075291:0:6336:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787707149.075299:0:6336:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787707149.075304:0:6336:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787707149.075761:0:6336:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787707149.075774:0:6336:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787707149.080568:0:6336:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787707149.080852:0:6336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787707149.080910:0:6336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787707149.080959:0:6336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787707149.080977:0:6336:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787707149.080995:0:6336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bca2978f/0xc5f18d5f94ec06e4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707149.081013:0:6336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000055ecb2f1/0xc5f18d5f94ec06a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec069e expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707149.081020:0:6336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bca2978f/0xc5f18d5f94ec06e4 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707149.081066:0:6336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000055ecb2f1/0xc5f18d5f94ec06a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec069e expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707149.082620:0:6336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000055ecb2f1/0xc5f18d5f94ec06a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec069e expref: 11 pid: 5848 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707149.082649:0:6336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009785c9ca pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6336:1874546729684608:0@lo:104: 00000100:00100000:3.0:1787707149.082759:0:6336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707149.082870:0:6336:0:(client.c:2715:ptlrpc_set_wait()) set 0000000068e571b0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707149.082946:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729684608 00000100:00100000:1.0:1787707149.082955:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729684608 00000100:00100000:1.0:1787707149.083036:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787707149.083045:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4042077 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:6336:x1874546729684608:12345-0@lo:104: 00010000:00010000:1.0:1787707149.083061:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: 000000009c37343c/0xc5f18d5f94ec069e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec06a5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707149.083147:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787707149.083152:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4042077 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:6336:x1874546729684608:12345-0@lo:104: Request processed in 109us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707149.083159:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787707149.083209:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787707149.083220:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: 000000009c37343c/0xc5f18d5f94ec069e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec06a5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707149.083227:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009c37343c already unused, calling callback (00000000a2afe9b6) 10000000:00010000:0.0:1787707149.083230:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: 000000009c37343c/0xc5f18d5f94ec069e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec06a5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707149.083237:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: 000000009c37343c/0xc5f18d5f94ec069e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec06a5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787707149.083243:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: 000000009c37343c/0xc5f18d5f94ec069e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec06a5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707149.083249:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787707149.083295:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: 000000009c37343c/0xc5f18d5f94ec069e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec06a5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707149.083302:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787707149.083319:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: 000000009c37343c/0xc5f18d5f94ec069e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec06a5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707149.083324:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: 000000009c37343c/0xc5f18d5f94ec069e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec06a5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707149.083341:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707149.083344:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707149.083345:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707149.083353:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787707149.083363:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000235e7f81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729684736:0@lo:103: 00000100:00100000:0.0:1787707149.083436:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707149.083845:0:6336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009785c9ca pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6336:1874546729684608:0@lo:104: 00010000:00010000:3.0:1787707149.083866:0:6336:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000bca2978f/0xc5f18d5f94ec06e4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707149.084243:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729684736 00000100:00100000:2.0:1787707149.084250:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729684736 00010000:00010000:2.0:1787707149.084276:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000055ecb2f1/0xc5f18d5f94ec06a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec069e expref: 12 pid: 5848 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707149.084706:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787707149.084715:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005325cf9d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:3316:x1874546729684736:12345-0@lo:103: 00010000:00010000:2.0:1787707149.084739:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707149.084745:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000055ecb2f1/0xc5f18d5f94ec06a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec069e expref: 12 pid: 5848 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707149.084756:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000055ecb2f1/0xc5f18d5f94ec06a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec069e expref: 12 pid: 5848 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707149.084772:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000055ecb2f1/0xc5f18d5f94ec06a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec069e expref: 12 pid: 5848 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707149.084787:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bca2978f/0xc5f18d5f94ec06e4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707149.084794:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bca2978f/0xc5f18d5f94ec06e4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707149.084807:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bca2978f/0xc5f18d5f94ec06e4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707149.084813:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bca2978f/0xc5f18d5f94ec06e4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707149.084818:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bca2978f/0xc5f18d5f94ec06e4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707149.084824:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bca2978f/0xc5f18d5f94ec06e4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707149.084839:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bca2978f already unused, calling callback (0000000023854d45) 00010000:00010000:2.0:1787707149.084843:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bca2978f/0xc5f18d5f94ec06e4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707149.084850:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bca2978f/0xc5f18d5f94ec06e4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707149.084873:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bca2978f/0xc5f18d5f94ec06e4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707149.084882:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707149.084937:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005325cf9d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:3316:x1874546729684736:12345-0@lo:103: Request processed in 225us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707149.084945:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787707149.084991:0:6336:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000bca2978f/0xc5f18d5f94ec06e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707149.084998:0:6336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bca2978f/0xc5f18d5f94ec06e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707149.085003:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bca2978f/0xc5f18d5f94ec06e4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707149.088783:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000235e7f81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729684736:0@lo:103: 00010000:00010000:2.0:1787707149.560588:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707149.627285:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787707149.627315:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009785c9ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729684864:0@lo:400: 00000100:00100000:2.0:1787707149.627427:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707149.628529:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729684864 00000100:00100000:3.0:1787707149.628541:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729684864 00000100:00100000:3.0:1787707149.628595:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787707149.628604:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081e32e31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729684864:12345-0@lo:400: 00000100:00100000:3.0:1787707149.628685:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081e32e31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729684864:12345-0@lo:400: Request processed in 83us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707149.628693:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787707149.629426:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009785c9ca x1874546729684864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707149.629442:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009785c9ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729684864:0@lo:400: 00010000:00010000:0.0:1787707150.593263:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707151.609567:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707152.632700:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787707153.019706:0:5853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787707153.019713:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfa02b55800 from 1 10000000:01000000:3.0:1787707153.019716:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787707153.019756:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: 00000000bca2978f/0xc5f18d5f94ec06eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707153.019767:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: 00000000bca2978f/0xc5f18d5f94ec06eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707153.019799:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: 00000000bca2978f/0xc5f18d5f94ec06eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707153.019820:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002d33574e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729684992:0@lo:101: 00000100:00100000:3.0:1787707153.019877:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707153.019936:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 000000007be586f3 going to sleep for 11 seconds 00000100:00100000:0.0:1787707153.023626:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729684992 00000100:00100000:0.0:1787707153.023642:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729684992 00000100:00100000:0.0:1787707153.023711:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787707153.023720:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091db1a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:5853:x1874546729684992:12345-0@lo:101: 00010000:00010000:0.0:1787707153.023748:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707153.023776:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001593c2c2/0xc5f18d5f94ec06f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec06eb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707153.023802:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001593c2c2/0xc5f18d5f94ec06f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec06eb expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707153.023812:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001593c2c2/0xc5f18d5f94ec06f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec06eb expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707153.023821:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001593c2c2, rc 0) 00000100:00100000:0.0:1787707153.023893:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091db1a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:5853:x1874546729684992:12345-0@lo:101: Request processed in 175us (4016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707153.023912:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787707153.026636:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002d33574e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729684992:0@lo:101: 00010000:00010000:3.0:1787707153.026676:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: 00000000bca2978f/0xc5f18d5f94ec06eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec06f2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707153.026689:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: 00000000bca2978f/0xc5f18d5f94ec06eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec06f2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707153.027109:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002d33574e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729685120:0@lo:501: 00000100:00100000:3.0:1787707153.027168:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707153.027215:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 000000007be586f3 going to sleep for 11 seconds 00000100:00100000:0.0:1787707153.027425:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729685120 00000100:00100000:0.0:1787707153.027432:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729685120 00000100:00100000:0.0:1787707153.027487:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787707153.027495:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eaa8056b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:5853:x1874546729685120:12345-0@lo:501: 00000100:00100000:0.0:1787707153.031380:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eaa8056b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:5853:x1874546729685120:12345-0@lo:501: Request processed in 3865us (4192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707153.031397:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787707153.036850:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002d33574e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729685120:0@lo:501: 00000100:00100000:3.0:1787707153.036909:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002d33574e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729685248:0@lo:503: 00000100:00100000:3.0:1787707153.037616:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707153.037677:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 000000007be586f3 going to sleep for 11 seconds 00000100:00100000:3.0:1787707153.037706:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729685248 00000100:00100000:3.0:1787707153.037713:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729685248 00000100:00100000:3.0:1787707153.038613:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787707153.038626:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5a1c4bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:5853:x1874546729685248:12345-0@lo:503: 00000100:00100000:3.0:1787707153.039179:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5a1c4bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:5853:x1874546729685248:12345-0@lo:503: Request processed in 556us (1564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707153.039196:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787707153.039502:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002d33574e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729685248:0@lo:503: 00000100:00100000:1.0:1787707153.041974:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001956fc37 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6539:1874546729685376:0@lo:502: 00000100:00100000:1.0:1787707153.042055:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707153.042096:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729685376 00000100:00100000:1.0:1787707153.042104:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729685376 00000100:00100000:1.0:1787707153.042140:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787707153.042149:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000313395a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:6539:x1874546729685376:12345-0@lo:502: 00000100:00100000:1.0:1787707153.042847:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000313395a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:6539:x1874546729685376:12345-0@lo:502: Request processed in 697us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707153.042856:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787707153.043101:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ca56d851 going to sleep for 11 seconds 00000100:00100000:1.0:1787707153.043124:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001956fc37 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6539:1874546729685376:0@lo:502: 00000020:01000000:1.0:1787707153.043152:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787707153.043163:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707153.043165:0:6539:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787707153.043172:0:6539:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfa02b55800 00000020:00000080:1.0:1787707153.043174:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787707153.043219:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6539:1874546729685504:0@lo:502: 00000100:00100000:1.0:1787707153.043259:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707153.043284:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07275900 going to sleep for 11 seconds 00000100:00100000:3.0:1787707153.044113:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729685504 00000100:00100000:3.0:1787707153.044121:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729685504 00000100:00100000:3.0:1787707153.044160:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787707153.044170:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:6539:x1874546729685504:12345-0@lo:502: 00000100:00100000:3.0:1787707153.044396:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:6539:x1874546729685504:12345-0@lo:502: Request processed in 225us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707153.044402:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787707153.045283:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6539:1874546729685504:0@lo:502: 00000020:01000000:1.0:1787707153.045327:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787707153.045335:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707153.045337:0:6539:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787707153.045341:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787707153.045676:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787707153.045695:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787707153.045705:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd200/0xc5f18d5f94ec06eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec06f2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707153.045715:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd200/0xc5f18d5f94ec06eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec06f2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707153.658963:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707154.680463:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707154.749796:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729685632:0@lo:400: 00000100:00100000:2.0:1787707154.749868:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707154.750032:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729685760:0@lo:400: 00000100:00100000:1.0:1787707154.750076:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707154.750165:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729685632 00000100:00100000:2.0:1787707154.750173:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729685632 00000100:00100000:2.0:1787707154.750227:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787707154.750236:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:3315:x1874546729685632:12345-0@lo:400: 00000100:00100000:2.0:1787707154.750286:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:3315:x1874546729685632:12345-0@lo:400: Request processed in 51us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707154.750302:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787707154.750952:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729685760 00000100:00100000:2.0:1787707154.750958:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729685760 00000100:00100000:2.0:1787707154.750999:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787707154.751007:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729685760:12345-0@lo:400: 00000100:00100000:2.0:1787707154.751054:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729685760:12345-0@lo:400: Request processed in 48us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707154.751060:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787707154.751096:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729685632:0@lo:400: 00010000:00080000:2.0:1787707154.751130:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cfa0871d880 x1874546729685760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707154.751143:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729685760:0@lo:400: 00010000:00010000:1.0:1787707155.708500:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707156.730532:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787707156.779127:0:6685:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787707156.779130:0:6685:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787707156.779232:0:6685:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cfa34ab9800 00000020:01000004:3.0:1787707156.779248:0:6685:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787707156.779259:0:6685:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787707156.779273:0:6685:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cfa110e0000) 00000020:00000080:3.0:1787707156.779288:0:6685:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787707156.808772:0:6685:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787707156.809059:0:6685:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787707156.873647:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787707156.885707:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787707156.885746:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787707156.885805:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787707156.885832:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787707156.886800:0:6685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787707156.886812:0:6685:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787707156.886823:0:6685:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc5f18d5f94ec0700 00000020:01000004:2.0:1787707156.886831:0:6685:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787707156.886851:0:6685:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.146@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787707156.886855:0:6685:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787707156.886873:0:6685:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787707156.886877:0:6685:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787707156.886891:0:6685:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cfa058499b8) 00000020:00000080:2.0:1787707156.886902:0:6685:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1787707156.900148:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787707156.900418:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787707156.900426:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787707156.901329:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787707156.901346:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787707156.901911:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787707156.901918:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787707156.906336:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787707156.906903:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787707156.906910:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787707156.913055:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787707156.913171:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787707156.946803:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787707156.947057:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787707156.947064:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787707156.953407:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787707156.956136:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787707156.957050:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787707156.957061:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787707156.968051:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787707156.968586:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787707156.968594:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787707156.970019:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787707156.970041:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787707157.066022:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787707157.066612:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787707157.066621:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787707157.071718:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787707157.071735:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787707157.074965:0:6685:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787707157.074992:0:6685:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787707157.074999:0:6685:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.146@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787707157.101693:0:6685:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.146@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787707157.101807:0:6685:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.146@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1787707157.101813:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787707157.101814:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787707157.101816:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787707157.101817:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787707157.101819:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787707157.101820:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787707157.101822:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787707157.101823:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787707157.101825:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787707157.101827:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787707157.101828:0:6685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787707157.101832:0:6685:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1787707157.101835:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787707157.101837:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787707157.101838:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787707157.101839:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787707157.101840:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787707157.101842:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787707157.101843:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787707157.101844:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787707157.101845:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787707157.101846:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787707157.101852:0:6685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787707157.101878:0:6685:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787707157.101895:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729685888:0@lo:253: 00000100:00100000:1.0:1787707157.101969:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707157.102055:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0734f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787707157.102411:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729685888 00000100:00100000:0.0:1787707157.102420:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729685888 00000100:00100000:0.0:1787707157.102598:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787707157.102608:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:6685:x1874546729685888:12345-0@lo:253: 20000000:01000000:0.0:1787707157.102639:0:5850:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787707157.102643:0:5850:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787707157.102649:0:5850:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787707157.102653:0:5850:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787707157.103549:0:5850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787707157.103763:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787707157.103777:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787707157.103833:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1787707157.103841:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787707157.103872:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1787707157.103930:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1787707157.104291:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787707157.104309:0:5850:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.146@tcp 20000000:01000000:0.0:1787707157.104312:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.146@tcp (null) (null) (null) 00000040:00080000:0.0:1787707157.104347:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787707157.104355:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787707157.104423:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787707157.104432:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.146@tcp (null) (null) 00000040:00080000:0.0:1787707157.104464:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787707157.104488:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787707157.104522:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787707157.104598:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1787707157.105599:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787707157.105621:0:5850:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.146@tcp 20000000:01000000:0.0:1787707157.105624:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.146@tcp (null) (null) (null) 00000040:00080000:0.0:1787707157.105662:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787707157.105670:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787707157.105700:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787707157.105707:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.146@tcp (null) (null) 00000040:00080000:0.0:1787707157.105752:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787707157.105761:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787707157.105792:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1787707157.105827:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1787707157.105845:0:5850:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787707157.105848:0:5850:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787707157.105852:0:5850:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787707157.105865:0:5850:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787707157.105868:0:5850:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787707157.105902:0:5850:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787707157.105905:0:5850:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787707157.106600:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1787707157.106904:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1787707157.106964:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1787707157.107032:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1787707157.107046:0:5850:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787707157.107049:0:5850:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787707157.107657:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1787707157.107709:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1787707157.107757:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1787707157.108022:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1787707157.108061:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1787707157.108096:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1787707157.108107:0:5850:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787707157.108109:0:5850:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787707157.108972:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1787707157.109036:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1787707157.109118:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787707157.109762:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787707157.109809:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787707157.109882:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1787707157.109899:0:5850:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1787707157.109901:0:5850:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1787707157.109910:0:5850:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787707157.109930:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfa00030c00/0xc5f18d5f94ec070e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.109950:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa00030600/0xc5f18d5f94ec0627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0620 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.109957:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec0643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec063c expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.109965:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec06b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec06ac expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.109973:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfa00030c00/0xc5f18d5f94ec070e lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.110012:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec06b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec06ac expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.110028:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec06b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec06ac expref: 12 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707157.110042:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874546729686016:0@lo:104: 00000100:00100000:0.0:1787707157.110107:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787707157.110175:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec0643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec063c expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.110184:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec0643 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec063c expref: 12 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707157.110207:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874546729686144:0@lo:104: 00000100:00100000:0.0:1787707157.110230:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787707157.110258:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa00030600/0xc5f18d5f94ec0627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec0620 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.110267:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa00030600/0xc5f18d5f94ec0627 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0620 expref: 12 pid: 5850 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707157.110274:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874546729686272:0@lo:104: 00000100:00100000:0.0:1787707157.110295:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707157.110305:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05df9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787707157.110391:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729686016 00000100:00100000:2.0:1787707157.110399:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729686016 00000100:00100000:2.0:1787707157.110435:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729686144 00000100:00100000:2.0:1787707157.110439:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729686144 00000100:00100000:2.0:1787707157.110448:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729686272 00000100:00100000:2.0:1787707157.110450:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729686272 00000100:00100000:2.0:1787707157.110478:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787707157.110487:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+5:5850:x1874546729686016:12345-0@lo:104: 00010000:00010000:2.0:1787707157.110500:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec06ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec06b3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.110563:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787707157.110570:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+5:5850:x1874546729686016:12345-0@lo:104: Request processed in 83us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707157.110587:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787707157.110610:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787707157.110616:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+4:5850:x1874546729686144:12345-0@lo:104: 00010000:00010000:2.0:1787707157.110625:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc000/0xc5f18d5f94ec063c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0643 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.110656:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787707157.110661:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+4:5850:x1874546729686144:12345-0@lo:104: Request processed in 46us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707157.110668:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787707157.110678:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787707157.110684:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:5850:x1874546729686272:12345-0@lo:104: 00010000:00010000:2.0:1787707157.110691:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec0620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0627 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.110715:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787707157.110720:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:5850:x1874546729686272:12345-0@lo:104: Request processed in 37us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707157.110726:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787707157.110743:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787707157.110749:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec06ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec06b3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.110756:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4000 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:2.0:1787707157.110760:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec06ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec06b3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.110768:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec06ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec06b3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787707157.110785:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec06ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec06b3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707157.110791:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787707157.110818:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec06ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec06b3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.110824:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787707157.110841:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec06ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec06b3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.110848:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec06ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec06b3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.110861:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787707157.110864:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc000/0xc5f18d5f94ec063c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0643 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.110870:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa013fc000 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:2.0:1787707157.110872:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc000/0xc5f18d5f94ec063c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec0643 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.110879:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc000/0xc5f18d5f94ec063c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec0643 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787707157.110885:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc000/0xc5f18d5f94ec063c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec0643 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707157.110890:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787707157.110910:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc000/0xc5f18d5f94ec063c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0643 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.110916:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787707157.110930:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc000/0xc5f18d5f94ec063c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0643 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.110936:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc000/0xc5f18d5f94ec063c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0643 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.110947:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787707157.110949:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec0620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0627 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.110954:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd400 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:2.0:1787707157.110956:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec0620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec0627 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.110963:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec0620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec0627 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787707157.110968:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec0620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec0627 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707157.110973:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787707157.110984:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec0620 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0627 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.110990:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787707157.110994:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec0620 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0627 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.111009:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec0620 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0627 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.111024:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707157.111026:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707157.111027:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707157.111041:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729686400:0@lo:103: 00000100:00100000:2.0:1787707157.111068:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707157.111100:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729686528:0@lo:103: 00000100:00100000:2.0:1787707157.111121:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707157.111138:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787707157.111143:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729686656:0@lo:103: 00000100:00100000:2.0:1787707157.111162:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707157.111188:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729686400 00000100:00100000:2.0:1787707157.111192:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729686400 00010000:00010000:2.0:1787707157.111210:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec06b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec06ac expref: 13 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707157.111225:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729686528 00000100:00100000:2.0:1787707157.111228:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729686528 00010000:00010000:2.0:1787707157.111239:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec0643 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec063c expref: 14 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707157.111248:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729686656 00000100:00100000:2.0:1787707157.111250:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729686656 00010000:00010000:2.0:1787707157.111258:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa00030600/0xc5f18d5f94ec0627 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0620 expref: 15 pid: 5850 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707157.111268:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787707157.111282:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:3317:x1874546729686400:12345-0@lo:103: 00010000:00010000:2.0:1787707157.111291:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707157.111296:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec06b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec06ac expref: 15 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.111306:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec06b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec06ac expref: 15 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.111322:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707157.111349:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:3317:x1874546729686400:12345-0@lo:103: Request processed in 67us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707157.111355:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787707157.111395:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787707157.111401:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:3314:x1874546729686528:12345-0@lo:103: 00010000:00010000:2.0:1787707157.111408:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707157.111413:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec0643 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec063c expref: 14 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.111421:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec0643 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec063c expref: 14 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.111430:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707157.111455:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:3314:x1874546729686528:12345-0@lo:103: Request processed in 55us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707157.111461:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787707157.111472:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787707157.111478:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:3314:x1874546729686656:12345-0@lo:103: 00010000:00010000:2.0:1787707157.111485:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707157.111497:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa00030600/0xc5f18d5f94ec0627 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0620 expref: 13 pid: 5850 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.111506:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa00030600/0xc5f18d5f94ec0627 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0620 expref: 13 pid: 5850 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.111518:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfa00030c00/0xc5f18d5f94ec070e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.111525:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa00030c00/0xc5f18d5f94ec070e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.111537:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa00030c00/0xc5f18d5f94ec070e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.111544:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa00030c00/0xc5f18d5f94ec070e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.111551:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfa00030c00/0xc5f18d5f94ec070e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.111558:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfa00030c00/0xc5f18d5f94ec070e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.111563:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa00030c00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707157.111566:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfa00030c00/0xc5f18d5f94ec070e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.111572:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfa00030c00/0xc5f18d5f94ec070e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.111594:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfa00030c00/0xc5f18d5f94ec070e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.111614:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707157.111637:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:3314:x1874546729686656:12345-0@lo:103: Request processed in 159us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707157.111643:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787707157.111679:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729686400:0@lo:103: 00000100:00100000:2.0:1787707157.111704:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729686656:0@lo:103: 00000100:00100000:2.0:1787707157.111711:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729686528:0@lo:103: 00010000:00010000:0.0:1787707157.111910:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707157.111939:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec06b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec06ac expref: 12 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707157.111953:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874546729686016:0@lo:104: 00010000:00010000:0.0:1787707157.111962:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec0643 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec063c expref: 11 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707157.111970:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874546729686144:0@lo:104: 00010000:00010000:0.0:1787707157.111979:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa00030600/0xc5f18d5f94ec0627 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec0620 expref: 10 pid: 5850 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707157.111986:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874546729686272:0@lo:104: 00010000:00010000:0.0:1787707157.112005:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfa00030c00/0xc5f18d5f94ec070e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.112012:0:5850:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfa00030c00/0xc5f18d5f94ec070e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.112026:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfa00030c00/0xc5f18d5f94ec070e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.112031:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa00030c00/0xc5f18d5f94ec070e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787707157.112043:0:5850:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787707157.197605:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+9:6685:x1874546729685888:12345-0@lo:253: Request processed in 94989us (95626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707157.197619:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787707157.197725:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729685888:0@lo:253: 10000000:01000000:1.0:1787707157.197742:0:6685:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787707157.197745:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787707157.197747:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787707157.197748:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787707157.197749:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787707157.197750:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787707157.197751:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787707157.197753:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787707157.197754:0:6685:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787707157.197755:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787707157.197756:0:6685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787707157.197776:0:6685:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cfa34ab9800 from lustre-OST0000 10000000:01000000:1.0:1787707157.197798:0:6685:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787707157.197800:0:6685:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787707157.197807:0:6685:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cfa05848000 local copy 10000000:01000000:1.0:1787707157.197811:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787707157.197845:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0715 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.197855:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0715 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.197864:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0715 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707157.197880:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729686784:0@lo:101: 00000100:00100000:1.0:1787707157.197918:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707157.198050:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa04f91d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787707157.198247:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729686784 00000100:00100000:3.0:1787707157.198254:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729686784 00000100:00100000:3.0:1787707157.198337:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787707157.198347:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+9:6685:x1874546729686784:12345-0@lo:101: 00010000:00010000:3.0:1787707157.198360:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707157.198556:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa421fca00/0xc5f18d5f94ec071c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0715 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707157.198593:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa421fca00/0xc5f18d5f94ec071c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0715 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707157.198603:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa421fca00/0xc5f18d5f94ec071c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0715 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707157.198612:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fca00, rc 0) 00000100:00100000:3.0:1787707157.198661:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+10:6685:x1874546729686784:12345-0@lo:101: Request processed in 316us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707157.198667:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787707157.198738:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729686784:0@lo:101: 00010000:00010000:1.0:1787707157.198752:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0715 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc5f18d5f94ec071c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.198761:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0715 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc5f18d5f94ec071c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707157.198880:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729686912:0@lo:501: 00000100:00100000:1.0:1787707157.198907:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707157.199021:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa04f91d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787707157.199325:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729686912 00000100:00100000:2.0:1787707157.199332:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729686912 00000100:00100000:2.0:1787707157.199360:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787707157.199383:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+10:6685:x1874546729686912:12345-0@lo:501: 00000100:00100000:2.0:1787707157.199701:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+10:6685:x1874546729686912:12345-0@lo:501: Request processed in 333us (791us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787707157.199708:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787707157.199860:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729686912:0@lo:501: 10000000:01000000:1.0:1787707157.199876:0:6685:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787707157.199906:0:6685:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787707157.199913:0:6685:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0715 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc5f18d5f94ec071c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.199922:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0715 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc5f18d5f94ec071c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.199929:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc5f18d5f94ec071c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.199956:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787707157.199978:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cfa34ab9800 10000000:01000000:1.0:1787707157.199983:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787707157.199988:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cfa05848000 10000000:01000000:1.0:1787707157.199991:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787707157.199994:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8cfa05848000 from 1 10000000:01000000:1.0:1787707157.200009:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787707157.200035:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4c00/0xc5f18d5f94ec0723 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.200048:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4c00/0xc5f18d5f94ec0723 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.200058:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4c00/0xc5f18d5f94ec0723 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.200066:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787707157.200072:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc5f18d5f94ec071c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707157.200074:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729687040:0@lo:101: 00010000:00010000:2.0:1787707157.200080:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d5400 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:2.0:1787707157.200083:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc5f18d5f94ec071c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.200091:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xc5f18d5f94ec071c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787707157.200099:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xc5f18d5f94ec071c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707157.200104:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707157.200140:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa04f91540 going to sleep for 11 seconds 00000100:00100000:3.0:1787707157.200198:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729687040 00000100:00100000:3.0:1787707157.200204:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729687040 00000100:00100000:3.0:1787707157.200274:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787707157.200283:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+10:6685:x1874546729687040:12345-0@lo:101: 00010000:00010000:3.0:1787707157.200291:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707157.200303:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa421fd000/0xc5f18d5f94ec072a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0723 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707157.200322:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa421fd000/0xc5f18d5f94ec072a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0723 expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707157.200332:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa421fd000/0xc5f18d5f94ec072a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0723 expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707157.200348:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fd000, rc 0) 00000100:00100000:3.0:1787707157.200414:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:6685:x1874546729687040:12345-0@lo:101: Request processed in 132us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707157.200420:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 10000000:01000000:2.0:1787707157.200478:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787707157.200499:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0715 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc5f18d5f94ec071c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.200505:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787707157.200522:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0715 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc5f18d5f94ec071c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.200529:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0715 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc5f18d5f94ec071c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.200550:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707157.200552:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707157.200554:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707157.200565:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729687168:0@lo:103: 00000100:00100000:0.0:1787707157.200593:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729687040:0@lo:101: 00010000:00010000:0.0:1787707157.200605:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4c00/0xc5f18d5f94ec0723 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec072a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.200612:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4c00/0xc5f18d5f94ec0723 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec072a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707157.200627:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787707157.200683:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4c00/0xc5f18d5f94ec0723 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec072a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.200691:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4c00/0xc5f18d5f94ec0723 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec072a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707157.200697:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787707157.200702:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787707157.200705:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787707157.200707:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787707157.200732:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa00030c00/0xc5f18d5f94ec0731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.200738:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa00030c00/0xc5f18d5f94ec0731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.200744:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa00030c00/0xc5f18d5f94ec0731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707157.200756:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729687296:0@lo:101: 00000100:00100000:0.0:1787707157.200782:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707157.200802:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05df9300 going to sleep for 11 seconds 00000100:00100000:0.0:1787707157.200817:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729687296 00000100:00100000:0.0:1787707157.200821:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729687296 00000100:00100000:2.0:1787707157.200835:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707157.200845:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787707157.200851:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:6685:x1874546729687296:12345-0@lo:101: 00010000:00010000:0.0:1787707157.200858:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707157.200867:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa00030600/0xc5f18d5f94ec0738 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0731 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707157.200870:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729687168 00000100:00100000:2.0:1787707157.200874:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729687168 00010000:00010000:0.0:1787707157.200880:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa00030600/0xc5f18d5f94ec0738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0731 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.200888:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa00030600/0xc5f18d5f94ec0738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0731 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.200895:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa00030600, rc 0) 00000100:00100000:2.0:1787707157.200898:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787707157.200904:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:3316:x1874546729687168:12345-0@lo:103: 00010000:00010000:2.0:1787707157.200913:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787707157.200920:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:6685:x1874546729687296:12345-0@lo:101: Request processed in 70us (138us total) trans 0 rc 0/0 00010000:00010000:2.0:1787707157.200924:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa421fca00/0xc5f18d5f94ec071c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f18d5f94ec0715 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707157.200926:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1787707157.200935:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707157.200960:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:3316:x1874546729687168:12345-0@lo:103: Request processed in 56us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707157.200964:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729687296:0@lo:101: 00000100:00100000:2.0:1787707157.200966:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787707157.200974:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa00030c00/0xc5f18d5f94ec0731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0738 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.200981:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa00030c00/0xc5f18d5f94ec0731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0738 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707157.200993:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729687168:0@lo:103: 00000100:00100000:0.0:1787707157.201051:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729687424:0@lo:501: 00000100:00100000:0.0:1787707157.201074:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707157.201096:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05df9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787707157.201141:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729687424 00000100:00100000:3.0:1787707157.201146:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729687424 00000100:00100000:3.0:1787707157.201174:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787707157.201181:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:6685:x1874546729687424:12345-0@lo:501: 00000100:00100000:3.0:1787707157.201408:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:6685:x1874546729687424:12345-0@lo:501: Request processed in 227us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707157.201414:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787707157.201500:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729687424:0@lo:501: 00000100:00100000:0.0:1787707157.201528:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729687552:0@lo:503: 00000100:00100000:0.0:1787707157.201564:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707157.201601:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05df9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787707157.201711:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729687552 00000100:00100000:3.0:1787707157.201716:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729687552 00000100:00100000:3.0:1787707157.201742:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787707157.201748:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:6685:x1874546729687552:12345-0@lo:503: 00000100:00100000:3.0:1787707157.201894:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:6685:x1874546729687552:12345-0@lo:503: Request processed in 144us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707157.201900:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787707157.201942:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729687552:0@lo:503: 00000040:00080000:2.0:1787707157.202426:0:6685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787707157.202844:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729687680:0@lo:502: 00000100:00100000:3.0:1787707157.202891:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707157.202955:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073bca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787707157.202993:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729687680 00000100:00100000:2.0:1787707157.202998:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729687680 00000100:00100000:2.0:1787707157.203067:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787707157.203075:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:6685:x1874546729687680:12345-0@lo:502: 00000100:00100000:2.0:1787707157.203253:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:6685:x1874546729687680:12345-0@lo:502: Request processed in 177us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707157.203260:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787707157.203339:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729687680:0@lo:502: 00000040:00080000:0.0:1787707157.203677:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787707157.203733:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787707157.203762:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787707157.203806:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787707157.203841:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787707157.203873:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787707157.203900:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729687808:0@lo:502: 00000100:00100000:0.0:1787707157.203941:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707157.204183:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05df9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787707157.204290:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729687808 00000100:00100000:3.0:1787707157.204296:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729687808 00000100:00100000:3.0:1787707157.204325:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787707157.204332:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:6685:x1874546729687808:12345-0@lo:502: 00000100:00100000:3.0:1787707157.204627:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:6685:x1874546729687808:12345-0@lo:502: Request processed in 293us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707157.204640:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787707157.204705:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729687808:0@lo:502: 00000040:00080000:0.0:1787707157.204791:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787707157.204801:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1787707157.205353:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787707157.205363:0:6703:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787707157.205394:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787707157.205398:0:6703:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787707157.205405:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787707157.205420:0:6703:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cfa110e3370) 00000020:00000080:3.0:1787707157.205441:0:6703:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787707157.205448:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787707157.205538:0:6703:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfa34ab9800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787707157.205545:0:6703:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787707157.205551:0:6703:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc5f18d5f94ec0746 00010000:00010000:3.0:1787707157.215694:0:6703:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1787707157.216032:0:6703:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787707157.222334:0:6703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787707157.222682:0:6703:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787707157.232733:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787707157.233253:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787707157.240662:0:6703:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787707157.240675:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787707157.240683:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707157.240685:0:6703:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787707157.240690:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787707157.240693:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707157.240695:0:6703:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787707157.240698:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787707157.240700:0:6703:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787707157.240764:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787707157.240768:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707157.240769:0:6703:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787707157.240772:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787707157.240840:0:6685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787707157.240864:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787707157.240887:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa00030c00/0xc5f18d5f94ec0731 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0738 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.240900:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa00030c00/0xc5f18d5f94ec0731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0738 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707157.240909:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfa34ab9800 from 1 10000000:01000000:0.0:1787707157.240912:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787707157.240949:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa00031c00/0xc5f18d5f94ec074d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.240958:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa00031c00/0xc5f18d5f94ec074d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.240969:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa00031c00/0xc5f18d5f94ec074d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707157.241003:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729687936:0@lo:101: 00000100:00100000:0.0:1787707157.241071:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707157.241122:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05df9780 going to sleep for 11 seconds 00000100:00100000:3.0:1787707157.241698:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729687936 00000100:00100000:3.0:1787707157.241707:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729687936 00000100:00100000:3.0:1787707157.241758:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787707157.241769:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:6685:x1874546729687936:12345-0@lo:101: 00010000:00010000:3.0:1787707157.241782:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707157.241795:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa421fc600/0xc5f18d5f94ec0754 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec074d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707157.241819:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa421fc600/0xc5f18d5f94ec0754 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec074d expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707157.241830:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa421fc600/0xc5f18d5f94ec0754 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec074d expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707157.241853:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fc600, rc 0) 00000100:00100000:3.0:1787707157.241913:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:6685:x1874546729687936:12345-0@lo:101: Request processed in 145us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707157.241919:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787707157.244100:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729687936:0@lo:101: 00010000:00010000:2.0:1787707157.244131:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa00031c00/0xc5f18d5f94ec074d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0754 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.244143:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa00031c00/0xc5f18d5f94ec074d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0754 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707157.244294:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729688064:0@lo:501: 00000100:00100000:2.0:1787707157.244359:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707157.244418:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa08c0b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787707157.244626:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729688064 00000100:00100000:0.0:1787707157.244634:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729688064 00000100:00100000:0.0:1787707157.244685:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787707157.244696:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07314450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:6685:x1874546729688064:12345-0@lo:501: 00000100:00100000:0.0:1787707157.254230:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07314450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:6685:x1874546729688064:12345-0@lo:501: Request processed in 9525us (9860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707157.254250:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787707157.254658:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729688064:0@lo:501: 00000100:00100000:2.0:1787707157.254711:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729688192:0@lo:503: 00000100:00100000:2.0:1787707157.258196:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707157.258280:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa08c0b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787707157.258421:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729688192 00000100:00100000:0.0:1787707157.258429:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729688192 00000100:00100000:0.0:1787707157.258490:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787707157.258513:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07316850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:6685:x1874546729688192:12345-0@lo:503: 00000100:00100000:0.0:1787707157.258816:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07316850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:6685:x1874546729688192:12345-0@lo:503: Request processed in 317us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707157.258824:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787707157.262712:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729688192:0@lo:503: 00000040:00080000:2.0:1787707157.263049:0:6685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787707157.263145:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729688320:0@lo:502: 00000100:00100000:2.0:1787707157.263219:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707157.263265:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa12a09e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787707157.263414:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729688320 00000100:00100000:0.0:1787707157.263421:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729688320 00000100:00100000:0.0:1787707157.263468:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787707157.263477:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07314050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:6685:x1874546729688320:12345-0@lo:502: 00000100:00100000:0.0:1787707157.263710:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07314050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:6685:x1874546729688320:12345-0@lo:502: Request processed in 233us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707157.263718:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787707157.264650:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729688320:0@lo:502: 00000040:00080000:2.0:1787707157.267200:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787707157.267294:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787707157.267346:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729688448:0@lo:502: 00000100:00100000:2.0:1787707157.268856:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707157.268913:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa12a09e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787707157.269718:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729688448 00000100:00100000:1.0:1787707157.269731:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729688448 00000100:00100000:1.0:1787707157.269796:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787707157.269807:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07316050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:6685:x1874546729688448:12345-0@lo:502: 00000100:00100000:1.0:1787707157.270088:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07316050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:6685:x1874546729688448:12345-0@lo:502: Request processed in 281us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707157.270096:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787707157.270638:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729688448:0@lo:502: 00000040:00080000:2.0:1787707157.270819:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787707157.270835:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787707157.272804:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787707157.272817:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787707157.272820:0:6707:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787707157.272828:0:6707:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfa34ab9800 00000020:00000080:3.0:1787707157.272830:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787707157.272851:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787707157.272855:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787707157.272856:0:6707:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787707157.272859:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787707157.272977:0:6685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787707157.273002:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787707157.273029:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa00031c00/0xc5f18d5f94ec074d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0754 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.273040:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa00031c00/0xc5f18d5f94ec074d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0754 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707157.273078:0:6685:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787707157.273081:0:6685:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cfa34ab9800 10000000:01000000:0.0:1787707157.273084:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cfa34ab9800 10000000:01000000:0.0:1787707157.273088:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787707157.273094:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfa34ab9800 from 1 10000000:01000000:0.0:1787707157.273097:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787707157.273132:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa00031e00/0xc5f18d5f94ec075b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.273141:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa00031e00/0xc5f18d5f94ec075b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.273150:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa00031e00/0xc5f18d5f94ec075b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707157.273172:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729688576:0@lo:101: 00000100:00100000:0.0:1787707157.273253:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707157.273299:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05df9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787707157.274698:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729688576 00000100:00100000:2.0:1787707157.274714:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729688576 00000100:00100000:2.0:1787707157.274777:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787707157.274788:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:6685:x1874546729688576:12345-0@lo:101: 00010000:00010000:2.0:1787707157.274803:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707157.274820:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa013fc000/0xc5f18d5f94ec0762 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec075b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.274847:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa013fc000/0xc5f18d5f94ec0762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec075b expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.274857:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa013fc000/0xc5f18d5f94ec0762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec075b expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707157.274866:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa013fc000, rc 0) 00000100:00100000:2.0:1787707157.274938:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:6685:x1874546729688576:12345-0@lo:101: Request processed in 151us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707157.274958:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787707157.275089:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729688576:0@lo:101: 00010000:00010000:0.0:1787707157.275107:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa00031e00/0xc5f18d5f94ec075b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0762 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707157.275117:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa00031e00/0xc5f18d5f94ec075b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0762 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707157.275237:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729688704:0@lo:501: 00000100:00100000:0.0:1787707157.275271:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707157.275306:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05df9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787707157.275433:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729688704 00000100:00100000:3.0:1787707157.275438:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729688704 00000100:00100000:3.0:1787707157.275467:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787707157.275475:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:6685:x1874546729688704:12345-0@lo:501: 00000100:00100000:3.0:1787707157.275729:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:6685:x1874546729688704:12345-0@lo:501: Request processed in 254us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707157.275735:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787707157.276444:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729688704:0@lo:501: 00000100:00100000:0.0:1787707157.276511:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729688832:0@lo:503: 00000100:00100000:0.0:1787707157.276559:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707157.276597:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05df9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787707157.276973:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729688832 00000100:00100000:3.0:1787707157.276979:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729688832 00000100:00100000:3.0:1787707157.278853:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787707157.278865:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07316450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:6685:x1874546729688832:12345-0@lo:503: 00000100:00100000:3.0:1787707157.280051:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07316450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:6685:x1874546729688832:12345-0@lo:503: Request processed in 1180us (3483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707157.280064:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787707157.280421:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729688832:0@lo:503: 00000040:00080000:0.0:1787707157.280784:0:6685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787707157.280859:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729688960:0@lo:502: 00000100:00100000:0.0:1787707157.280922:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707157.280962:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05df9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787707157.281146:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729688960 00000100:00100000:2.0:1787707157.281152:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729688960 00000100:00100000:2.0:1787707157.281193:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787707157.281788:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07314850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:6685:x1874546729688960:12345-0@lo:502: 00000100:00100000:2.0:1787707157.282042:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07314850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:6685:x1874546729688960:12345-0@lo:502: Request processed in 258us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707157.282049:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787707157.283878:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729688960:0@lo:502: 00000040:00080000:3.0:1787707157.284237:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787707157.284302:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787707157.284339:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787707157.284426:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787707157.284466:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787707157.284543:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787707157.284596:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787707157.284630:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787707157.284689:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787707157.284729:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787707157.284766:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787707157.284817:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787707157.284855:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787707157.284890:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787707157.284939:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787707157.284977:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787707157.285012:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787707157.285059:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787707157.285096:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787707157.285145:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787707157.285197:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787707157.285235:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787707157.285271:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787707157.285319:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787707157.285356:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787707157.285425:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787707157.285488:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787707157.285529:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1787707157.285589:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729689088:0@lo:502: 00000100:00100000:3.0:1787707157.285666:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707157.285715:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0734f240 going to sleep for 11 seconds 00000100:00100000:0.0:1787707157.285822:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729689088 00000100:00100000:0.0:1787707157.285829:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729689088 00000100:00100000:0.0:1787707157.285881:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787707157.285897:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07315050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:6685:x1874546729689088:12345-0@lo:502: 00000100:00100000:0.0:1787707157.286099:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07315050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:6685:x1874546729689088:12345-0@lo:502: Request processed in 209us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707157.286107:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787707157.286777:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729689088:0@lo:502: 00000040:00080000:3.0:1787707157.286871:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787707157.286882:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787707157.287322:0:6708:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787707157.287338:0:6708:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cfa359f19b8) 00000020:00000080:0.0:1787707157.287362:0:6708:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1787707157.287756:0:6708:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfa34ab9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787707157.287761:0:6708:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfa34ab9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787707157.287764:0:6708:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfa34ab9800 3 00010000:00080000:1.0:1787707157.287794:0:6708:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf901153000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.146@tcp at head 00010000:00010000:1.0:1787707157.291354:0:6708:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1787707157.291959:0:6708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787707157.291995:0:6708:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787707157.292016:0:6708:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc5f18d5f94ec0770 00000100:00080000:1.0:1787707157.292027:0:6708:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787707157.292034:0:6708:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cf901153000 using connection 192.168.204.146@tcp/0@lo 00000100:00100000:1.0:1787707157.292076:0:6708:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfa3accea00 x1874546729689216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787707157.292137:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874546729689216:0@lo:38: 00000100:00100000:2.0:1787707157.292212:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787707157.292285:0:6708:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787707157.292548:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729689216 00000100:00100000:3.0:1787707157.292557:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729689216 00000100:00100000:3.0:1787707157.292603:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787707157.292611:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1874546729689216:12345-0@lo:38: 00010000:00080000:3.0:1787707157.292635:0:5858:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:3.0:1787707157.292668:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc5f18d5f94ec0777 00000004:00100000:3.0:1787707157.292682:0:5858:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787707157.292711:0:5858:0:(import.c:65:import_set_state_nolock()) ffff8cfa3fa32800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787707157.295011:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874546729689216:12345-0@lo:38: Request processed in 2391us (2790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707157.295026:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:1.0:1787707157.295257:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1787707157.295672:0:6685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787707157.295696:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787707157.295714:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa00031e00/0xc5f18d5f94ec075b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0762 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707157.295726:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa00031e00/0xc5f18d5f94ec075b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0762 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787707157.295774:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787707157.295777:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787707157.295778:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787707157.295779:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787707157.295781:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787707157.295782:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787707157.295784:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787707157.295791:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787707157.295792:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787707157.295794:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787707157.295795:0:6685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787707157.295799:0:6685:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787707157.295801:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787707157.295802:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787707157.295803:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787707157.295804:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787707157.295805:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787707157.295806:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787707157.295807:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787707157.295808:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787707157.295809:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787707157.295809:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787707157.295810:0:6685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787707157.295836:0:6685:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787707157.295854:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729689344:0@lo:253: 00000100:00100000:3.0:1787707157.295930:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787707157.300133:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cfa3accea00 x1874546729689216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787707167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707157.300150:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787707157.300160:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787707157.300169:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787707157.300174:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787707157.300177:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cf901153000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787707157.300184:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874546729689216:0@lo:38: 00000100:00100000:2.0:1787707157.300288:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729689472:0@lo:400: 00000100:00100000:2.0:1787707157.300352:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707157.303914:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0734fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787707157.304448:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729689344 00000100:00100000:2.0:1787707157.304468:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729689344 00000100:00100000:2.0:1787707157.304642:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787707157.304654:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07315850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:6685:x1874546729689344:12345-0@lo:253: 20000000:01000000:2.0:1787707157.304688:0:5851:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787707157.304713:0:5851:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787707157.305973:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729689472 00000100:00100000:1.0:1787707157.305986:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729689472 00000100:00100000:1.0:1787707157.306045:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787707157.306054:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729689472:12345-0@lo:400: 00000100:00100000:1.0:1787707157.306143:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729689472:12345-0@lo:400: Request processed in 89us (5792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707157.306149:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787707157.306206:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cfa0871d880 x1874546729689472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707157.306222:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729689472:0@lo:400: 20000000:01000000:2.0:1787707157.341802:0:5851:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787707157.341820:0:5851:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787707157.343213:0:5872:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787707157.343222:0:5872:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787707157.343246:0:5872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec077e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.343266:0:5872:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec06dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec06d6 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.343275:0:5872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec077e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.343316:0:5872:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec06dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec06d6 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.343331:0:5872:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec06dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec06d6 expref: 13 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707157.343358:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accc700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5872:1874546729689600:0@lo:104: 00000100:00100000:1.0:1787707157.343444:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707157.343499:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa04f91540 going to sleep for 11 seconds 00000100:00100000:1.0:1787707157.343522:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729689600 00000100:00100000:1.0:1787707157.343530:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729689600 00000100:00100000:1.0:1787707157.343583:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787707157.343592:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:5872:x1874546729689600:12345-0@lo:104: 00010000:00010000:1.0:1787707157.343606:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa013fdc00/0xc5f18d5f94ec06d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec06dd expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.343658:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787707157.343664:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:5872:x1874546729689600:12345-0@lo:104: Request processed in 73us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707157.343671:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787707157.343694:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787707157.343699:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa013fdc00/0xc5f18d5f94ec06d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec06dd expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.343706:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa013fdc00 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:1.0:1787707157.343710:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa013fdc00/0xc5f18d5f94ec06d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec06dd expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.343718:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa013fdc00/0xc5f18d5f94ec06d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec06dd expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787707157.343724:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa013fdc00/0xc5f18d5f94ec06d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec06dd expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707157.343739:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787707157.343766:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa013fdc00/0xc5f18d5f94ec06d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec06dd expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.343771:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787707157.343788:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa013fdc00/0xc5f18d5f94ec06d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec06dd expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.343794:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa013fdc00/0xc5f18d5f94ec06d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec06dd expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.343809:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707157.343811:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707157.343813:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707157.343825:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729689728:0@lo:103: 00000100:00100000:1.0:1787707157.343855:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707157.343892:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729689728 00000100:00100000:1.0:1787707157.343895:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729689728 00010000:00010000:1.0:1787707157.343911:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec06dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec06d6 expref: 14 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707157.343933:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787707157.343939:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa05e67850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:3314:x1874546729689728:12345-0@lo:103: 00010000:00010000:1.0:1787707157.343949:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707157.343954:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec06dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec06d6 expref: 14 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.343965:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec06dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec06d6 expref: 14 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.343987:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec077e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.343995:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec077e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787707157.344009:0:5843:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001260904s 00010000:00010000:1.0:1787707157.344014:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec077e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.344020:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec077e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.344026:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec077e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.344031:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec077e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.344037:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d5e00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:1.0:1787707157.344040:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec077e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.344048:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec077e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.344057:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec077e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.344067:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707157.344095:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa05e67850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:3314:x1874546729689728:12345-0@lo:103: Request processed in 156us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707157.344107:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787707157.344172:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729689728:0@lo:103: 00010000:00010000:1.0:1787707157.344196:0:5872:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec06dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec06d6 expref: 13 pid: 5848 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707157.344207:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accc700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5872:1874546729689600:0@lo:104: 00010000:00010000:1.0:1787707157.344216:0:5872:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec077e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.344224:0:5872:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec077e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.344230:0:5872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec077e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707157.344236:0:5872:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec077e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707157.350112:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07315850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:6685:x1874546729689344:12345-0@lo:253: Request processed in 45451us (54172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707157.350128:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787707157.350208:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6685:1874546729689344:0@lo:253: 10000000:01000000:3.0:1787707157.350223:0:6685:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787707157.350226:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787707157.350228:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787707157.350229:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787707157.350230:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787707157.350232:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787707157.350233:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787707157.350235:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787707157.350236:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787707157.350238:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787707157.350240:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787707157.350241:0:6685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787707157.350257:0:6685:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787707157.355802:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787707157.355969:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787707157.356169:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787707157.356339:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787707157.356718:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787707157.356912:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787707157.358211:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787707157.595261:0:6685:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787707157.595267:0:6685:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787707157.595362:0:6685:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787707157.595429:0:6685:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.146@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787707157.595441:0:6685:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787707157.595523:0:6685:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787707157.756717:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707158.777914:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707159.801072:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707160.829357:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707161.850851:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787707162.425696:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787707162.425704:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfa02b55800 from 21 10000000:01000000:1.0:1787707162.425710:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787707162.425743:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0785 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707162.425755:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0785 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707162.425767:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0785 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707162.425779:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729689984:0@lo:400: 00000100:00100000:1.0:1787707162.425792:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729689856:0@lo:101: 00000100:00100000:2.0:1787707162.425968:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729690112:0@lo:400: 00000100:00100000:1.0:1787707162.433110:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707162.433170:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1040f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707162.434050:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729689856 00000100:00100000:0.0:1787707162.434070:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729689856 00000100:00100000:0.0:1787707162.434120:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787707162.434130:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:5853:x1874546729689856:12345-0@lo:101: 00010000:00010000:0.0:1787707162.434147:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707162.434163:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa00030e00/0xc5f18d5f94ec078c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0785 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707162.434190:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa00030e00/0xc5f18d5f94ec078c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0785 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707162.434201:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa00030e00/0xc5f18d5f94ec078c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0785 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707162.434210:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa00030e00, rc 0) 00000100:00100000:0.0:1787707162.434263:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:5853:x1874546729689856:12345-0@lo:101: Request processed in 135us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707162.434270:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787707162.434309:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729690240:0@lo:400: 00000100:00100000:0.0:1787707162.434347:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707162.434434:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729690240 00000100:00100000:0.0:1787707162.434438:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729690240 00000100:00100000:0.0:1787707162.434489:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787707162.434496:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729690240:12345-0@lo:400: 00000100:00100000:0.0:1787707162.434546:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729690240:12345-0@lo:400: Request processed in 51us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707162.434553:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787707162.434587:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa3acb6300 x1874546729690240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707162.434612:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729690240:0@lo:400: 00000100:00100000:0.0:1787707162.434643:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729689856:0@lo:101: 00010000:00010000:0.0:1787707162.434659:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0785 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec078c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707162.434669:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0785 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec078c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707162.434725:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729690368:0@lo:501: 00000100:00100000:0.0:1787707162.434751:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707162.434767:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa032be840 going to sleep for 11 seconds 00000100:00100000:3.0:1787707162.438998:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787707162.439093:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707162.439112:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729690368 00000100:00100000:3.0:1787707162.439336:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729690368 00000100:00100000:3.0:1787707162.439402:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729689984 00000100:00100000:3.0:1787707162.439406:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729689984 00000100:00100000:3.0:1787707162.439426:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787707162.439434:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:5853:x1874546729690368:12345-0@lo:501: 00000100:00100000:3.0:1787707162.440012:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:5853:x1874546729690368:12345-0@lo:501: Request processed in 576us (5258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707162.440021:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787707162.440051:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787707162.440059:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:3315:x1874546729689984:12345-0@lo:400: 00000100:00100000:3.0:1787707162.440094:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:3315:x1874546729689984:12345-0@lo:400: Request processed in 36us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707162.440100:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787707162.440226:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729690368:0@lo:501: 00000100:00100000:3.0:1787707162.440280:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729690496:0@lo:503: 00000100:00100000:3.0:1787707162.440323:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707162.440339:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787707162.440350:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729690496 00000100:00100000:3.0:1787707162.440354:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729690496 00000100:00100000:3.0:1787707162.440398:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787707162.440405:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:5853:x1874546729690496:12345-0@lo:503: 00000100:00100000:3.0:1787707162.440760:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:5853:x1874546729690496:12345-0@lo:503: Request processed in 355us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707162.440768:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787707162.440805:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729690496:0@lo:503: 00000100:00100000:3.0:1787707162.440945:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729689984:0@lo:400: 00000100:00100000:3.0:1787707162.441033:0:6910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6910:1874546729690624:0@lo:502: 00000100:00100000:3.0:1787707162.441065:0:6910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707162.441086:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729690624 00000100:00100000:3.0:1787707162.441090:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729690624 00000100:00100000:3.0:1787707162.441110:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787707162.441116:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:6910:x1874546729690624:12345-0@lo:502: 00000100:00100000:3.0:1787707162.442557:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:6910:x1874546729690624:12345-0@lo:502: Request processed in 1432us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707162.442568:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787707162.444433:0:6910:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787707162.444470:0:6910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6910:1874546729690624:0@lo:502: 00000100:00100000:3.0:1787707162.444560:0:6910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6910:1874546729690752:0@lo:502: 00000100:00100000:3.0:1787707162.445249:0:6910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707162.445295:0:6910:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787707162.445633:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729690752 00000100:00100000:1.0:1787707162.445642:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729690752 00000100:00100000:1.0:1787707162.445689:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787707162.445698:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:6910:x1874546729690752:12345-0@lo:502: 00000100:00100000:1.0:1787707162.446493:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:6910:x1874546729690752:12345-0@lo:502: Request processed in 792us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707162.446503:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787707162.446813:0:6910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6910:1874546729690752:0@lo:502: 00000040:00080000:3.0:1787707162.446851:0:6910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787707162.447181:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787707162.447202:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787707162.447212:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0785 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec078c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707162.447222:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec078c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707162.447232:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787707162.447234:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfa02b55800 from 4 10000000:01000000:1.0:1787707162.447237:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787707162.447268:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec0793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707162.447276:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec0793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707162.447285:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec0793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707162.447312:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729690880:0@lo:101: 00000100:00100000:1.0:1787707162.447393:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707162.447411:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729690880 00000100:00100000:2.0:1787707162.447418:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729690880 00000100:00100000:2.0:1787707162.447823:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787707162.447833:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:5853:x1874546729690880:12345-0@lo:101: 00010000:00010000:2.0:1787707162.447844:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707162.447867:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec079a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0793 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707162.447974:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec079a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0793 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707162.447989:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec079a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0793 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707162.447998:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa013fc600, rc 0) 00000100:00100000:2.0:1787707162.448035:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:5853:x1874546729690880:12345-0@lo:101: Request processed in 204us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707162.448042:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787707162.448096:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707162.448264:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729690112 00000100:00100000:3.0:1787707162.448270:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729690112 00000100:00100000:3.0:1787707162.448303:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787707162.448310:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729690112:12345-0@lo:400: 00000100:00100000:3.0:1787707162.448347:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729690112:12345-0@lo:400: Request processed in 38us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707162.448354:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787707162.448536:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa3acb7800 x1874546729690112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707162.448549:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729690112:0@lo:400: 00000100:00100000:0.0:1787707162.449301:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1040f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787707162.449324:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729690880:0@lo:101: 00010000:00010000:0.0:1787707162.449346:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec0793 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec079a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707162.449662:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec0793 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec079a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707162.449724:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729691008:0@lo:256: 00000100:00100000:0.0:1787707162.449771:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707162.449790:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa032be840 going to sleep for 11 seconds 00000100:00100000:3.0:1787707162.450097:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729691008 00000100:00100000:3.0:1787707162.450105:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729691008 00000100:00100000:3.0:1787707162.450232:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787707162.450241:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:5853:x1874546729691008:12345-0@lo:256: 20000000:01000000:3.0:1787707162.450257:0:5850:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787707162.450274:0:5850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787707162.450277:0:5850:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787707162.450362:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:5853:x1874546729691008:12345-0@lo:256: Request processed in 122us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707162.450385:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787707162.450440:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729691008:0@lo:256: 10000000:01000000:3.0:1787707162.450499:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787707162.450507:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec0793 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec079a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707162.450516:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec0793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec079a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787707162.450530:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787707162.450533:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1787707162.450536:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787707162.450561:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec07a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707162.450570:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec07a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707162.450580:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec07a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707162.451954:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729691136:0@lo:101: 00000100:00100000:3.0:1787707162.452018:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707162.452059:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b3900 going to sleep for 11 seconds 00000100:00100000:0.0:1787707162.452113:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729691136 00000100:00100000:0.0:1787707162.452122:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729691136 00000100:00100000:0.0:1787707162.452167:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787707162.452176:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:5853:x1874546729691136:12345-0@lo:101: 00010000:00010000:0.0:1787707162.452199:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707162.452217:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa00030000/0xc5f18d5f94ec07a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec07a1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707162.452243:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa00030000/0xc5f18d5f94ec07a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec07a1 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707162.452254:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa00030000/0xc5f18d5f94ec07a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec07a1 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707162.452263:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa00030000, rc 0) 00000100:00100000:0.0:1787707162.452300:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:5853:x1874546729691136:12345-0@lo:101: Request processed in 125us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707162.452306:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787707162.453880:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729691136:0@lo:101: 00010000:00010000:3.0:1787707162.453918:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec07a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec07a8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707162.453934:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec07a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec07a8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707162.454015:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729691264:0@lo:501: 00000100:00100000:3.0:1787707162.454064:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707162.454100:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b3900 going to sleep for 11 seconds 00000100:00100000:3.0:1787707162.454119:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729691264 00000100:00100000:3.0:1787707162.454137:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729691264 00000100:00100000:3.0:1787707162.454175:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787707162.454192:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:5853:x1874546729691264:12345-0@lo:501: 00000100:00100000:3.0:1787707162.454468:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:5853:x1874546729691264:12345-0@lo:501: Request processed in 276us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707162.454487:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787707162.454523:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729691264:0@lo:501: 00000100:00100000:3.0:1787707162.454550:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729691392:0@lo:503: 00000100:00100000:3.0:1787707162.454587:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707162.454938:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b3900 going to sleep for 11 seconds 00000100:00100000:2.0:1787707162.455403:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729691392 00000100:00100000:2.0:1787707162.455410:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729691392 00000100:00100000:2.0:1787707162.455447:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787707162.455455:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:5853:x1874546729691392:12345-0@lo:503: 00000100:00100000:2.0:1787707162.459865:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:5853:x1874546729691392:12345-0@lo:503: Request processed in 4402us (5269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707162.459880:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787707162.460159:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729691392:0@lo:503: 00000100:00100000:3.0:1787707162.460715:0:6914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6914:1874546729691520:0@lo:502: 00000100:00100000:3.0:1787707162.460766:0:6914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707162.460800:0:6914:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b3900 going to sleep for 11 seconds 00000100:00100000:2.0:1787707162.463922:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729691520 00000100:00100000:2.0:1787707162.463937:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729691520 00000100:00100000:2.0:1787707162.464007:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787707162.464018:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:6914:x1874546729691520:12345-0@lo:502: 00000100:00100000:2.0:1787707162.464928:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:6914:x1874546729691520:12345-0@lo:502: Request processed in 906us (4156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707162.464939:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787707162.467584:0:6914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6914:1874546729691520:0@lo:502: 00000020:01000000:3.0:1787707162.467640:0:6914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787707162.467647:0:6914:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787707162.467656:0:6914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787707162.467658:0:6914:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787707162.467664:0:6914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787707162.467667:0:6914:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.146@tcp to nid 0x20000c0a8cc92 (192.168.204.146@tcp) 00000020:01000000:3.0:1787707162.467693:0:6914:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787707162.467696:0:6914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787707162.467713:0:6914:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cfa110e19b8) 00000020:00000080:3.0:1787707162.467733:0:6914:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787707162.467737:0:6914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787707162.467823:0:6914:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787707162.467829:0:6914:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787707162.467850:0:6914:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f18d5f94ec07b6 00010000:00080000:3.0:1787707162.467879:0:6914:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfa35b30800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.146@tcp at head 00010000:00010000:3.0:1787707162.468108:0:6914:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787707162.525452:0:6914:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787707162.525493:0:6914:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787707162.529512:0:6914:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787707162.529748:0:6914:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787707162.529796:0:6914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787707162.529857:0:6914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787707162.533275:0:6917:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787707162.533283:0:6917:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787707162.534397:0:6914:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787707162.534411:0:6914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787707162.534445:0:6914:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787707162.534467:0:6914:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f18d5f94ec07bd 00000100:00080000:2.0:1787707162.534488:0:6914:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787707162.534494:0:6914:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cfa35b30800 using connection 192.168.204.146@tcp/0@lo 00000100:00100000:2.0:1787707162.534528:0:6914:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfa0871fb80 x1874546729691648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787707162.534555:0:6914:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1787707162.534603:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729691648:0@lo:8: 00000020:01000000:2.0:1787707162.534621:0:6914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787707162.534625:0:6914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707162.534627:0:6914:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787707162.534629:0:6914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787707162.534642:0:6914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707162.534644:0:6914:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787707162.534647:0:6914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787707162.534649:0:6914:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787707162.534672:0:6914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6914:1874546729691776:0@lo:502: 00000100:00100000:0.0:1787707162.534676:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707162.534712:0:6914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707162.534736:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729691776 00000100:00100000:2.0:1787707162.534742:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729691776 00000100:00100000:2.0:1787707162.534786:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787707162.534796:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:6914:x1874546729691776:12345-0@lo:502: 00000100:00100000:1.0:1787707162.535157:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729691648 00000100:00100000:1.0:1787707162.535162:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729691648 00000100:00100000:1.0:1787707162.535179:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787707162.535185:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1874546729691648:12345-0@lo:8: 00010000:00080000:1.0:1787707162.535206:0:6688:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:1.0:1787707162.535229:0:6688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f18d5f94ec07c4 00002000:00100000:1.0:1787707162.535259:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cf901156000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787707162.535263:0:6688:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1787707162.535267:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787707162.535398:0:6688:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787707162.535555:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787707162.535578:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8cf901154800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787707162.535638:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874546729691648:12345-0@lo:8: Request processed in 453us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707162.535646:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787707162.535708:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa0871fb80 x1874546729691648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787707172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707162.535729:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787707162.535736:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787707162.535743:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787707162.535748:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787707162.535750:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cfa35b30800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787707162.535759:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787707162.535764:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729691648:0@lo:8: 00000004:00080000:1.0:1787707162.535788:0:6917:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1787707162.536415:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:6914:x1874546729691776:12345-0@lo:502: Request processed in 1617us (1699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707162.536425:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787707162.536484:0:6914:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0734f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787707162.536499:0:6914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:6914:1874546729691776:0@lo:502: 00000020:01000000:2.0:1787707162.536524:0:6914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787707162.536530:0:6914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707162.536532:0:6914:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787707162.536536:0:6914:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1787707162.536691:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787707162.536710:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787707162.536722:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec07a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec07a8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707162.536733:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec07a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec07a8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707162.536742:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787707162.536744:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cfa05848000 from 1 10000000:01000000:0.0:1787707162.536747:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787707162.536773:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa00031200/0xc5f18d5f94ec07cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707162.536792:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa00031200/0xc5f18d5f94ec07cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707162.536802:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa00031200/0xc5f18d5f94ec07cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707162.536819:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729691904:0@lo:101: 00000100:00100000:0.0:1787707162.536857:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707162.536882:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa30b2f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707162.536899:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729691904 00000100:00100000:0.0:1787707162.536905:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729691904 00000100:00100000:0.0:1787707162.536938:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787707162.536947:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:5853:x1874546729691904:12345-0@lo:101: 00010000:00010000:0.0:1787707162.536957:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707162.536983:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec07d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec07cb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707162.537008:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec07d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec07cb expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707162.537032:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec07d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec07cb expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707162.537042:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2e00, rc 0) 00000100:00100000:0.0:1787707162.537073:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:5853:x1874546729691904:12345-0@lo:101: Request processed in 126us (215us total) trans 0 rc 0/0 00000004:00080000:1.0:1787707162.537079:0:6917:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 213583708225ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787707162.537079:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787707162.537113:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729691904:0@lo:101: 00010000:00010000:0.0:1787707162.537131:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa00031200/0xc5f18d5f94ec07cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec07d2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707162.537140:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa00031200/0xc5f18d5f94ec07cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec07d2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707162.537183:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729692032:0@lo:501: 00000100:00100000:0.0:1787707162.537209:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707162.537236:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa30b2f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707162.538001:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729692032 00000100:00100000:1.0:1787707162.538012:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729692032 00000100:00100000:1.0:1787707162.538058:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787707162.538066:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa18a93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:5853:x1874546729692032:12345-0@lo:501: 00000100:00100000:1.0:1787707162.538444:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa18a93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:5853:x1874546729692032:12345-0@lo:501: Request processed in 378us (1233us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787707162.538452:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787707162.538508:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729692032:0@lo:501: 10000000:01000000:1.0:1787707162.538536:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787707162.538545:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa00031200/0xc5f18d5f94ec07cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec07d2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707162.538555:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa00031200/0xc5f18d5f94ec07cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec07d2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787707162.712682:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787707162.712785:0:6918:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787707162.712821:0:6918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6918:1874546729692288:0@lo:7: 00000100:00100000:1.0:1787707162.712887:0:6918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707162.712929:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729692288 00000100:00100000:1.0:1787707162.712937:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729692288 00000100:00100000:1.0:1787707162.712992:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787707162.713001:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6918:x1874546729692288:12345-0@lo:7: 00000100:00100000:0.0:1787707162.715561:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729692160:0@lo:13: 00000100:00100000:0.0:1787707162.715633:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707162.715722:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729692160 00000100:00100000:0.0:1787707162.715730:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729692160 00000100:00100000:0.0:1787707162.715772:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787707162.715782:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874546729692160:12345-0@lo:13: 00002000:00000024:0.0:1787707162.715810:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787707162.715856:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874546729692160:12345-0@lo:13: Request processed in 75us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707162.715864:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787707162.715906:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa3accd180 x1874546729692160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707162.715927:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729692160:0@lo:13: 00000100:00080000:2.0:1787707162.717583:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787707162.718315:0:6918:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073bc540 going to sleep for 11 seconds 00002000:00080000:1.0:1787707162.726865:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1787707162.726876:0:6690:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787707162.726989:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6918:x1874546729692288:12345-0@lo:7: Request processed in 13984us (14097us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707162.727002:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787707162.727235:0:6918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa3accd500 x1874546729692288/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787707178 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707162.727250:0:6918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6918:1874546729692288:0@lo:7: 00000004:00080000:2.0:1787707162.727265:0:6918:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787707162.727301:0:6918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6918:1874546729692416:0@lo:5: 00000100:00100000:2.0:1787707162.727337:0:6918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707162.727394:0:6918:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa12a76d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787707162.730620:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729692416 00000100:00100000:1.0:1787707162.730637:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729692416 00000100:00100000:1.0:1787707162.730740:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787707162.730751:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6918:x1874546729692416:12345-0@lo:5: 00002000:00080000:1.0:1787707162.730787:0:6689:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787707162.730792:0:6689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787707162.734741:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6918:x1874546729692416:12345-0@lo:5: Request processed in 3986us (7397us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787707162.734755:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787707162.734883:0:6918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa0871d180 x1874546729692416/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787707178 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707162.734901:0:6918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6918:1874546729692416:0@lo:5: 00000004:00080000:0.0:1787707162.734925:0:6918:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787707162.734969:0:6918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6918:1874546729692544:0@lo:700: 00000100:00100000:0.0:1787707162.735010:0:6918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707162.735084:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729692544 00000100:00100000:0.0:1787707162.735091:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729692544 00000100:00100000:0.0:1787707162.735128:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787707162.735137:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6918:x1874546729692544:12345-0@lo:700: 00000100:00100000:0.0:1787707162.735171:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6696:1874546729692672:0@lo:700: 00000100:00100000:0.0:1787707162.735201:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707162.735231:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa30b2f900 going to sleep for 11 seconds 00000100:00100000:0.0:1787707162.735258:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729692672 00000100:00100000:0.0:1787707162.735262:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729692672 00000100:00100000:0.0:1787707162.735288:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787707162.735295:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6696:x1874546729692672:12345-0@lo:700: 00000100:00100000:0.0:1787707162.736037:0:6918:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa30b2f3c0 going to sleep for 11 seconds 40000000:02000000:0.0:1787707162.805364:0:5863:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1787707162.820108:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6696:x1874546729692672:12345-0@lo:700: Request processed in 84804us (84896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707162.820129:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787707162.820225:0:6696:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa3acc9c00 x1874546729692672/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787707178 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707162.820241:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6696:1874546729692672:0@lo:700: 40000000:02000000:0.0:1787707162.820254:0:6696:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:1.0:1787707162.880671:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707163.004242:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6918:x1874546729692544:12345-0@lo:700: Request processed in 269097us (269223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707163.004262:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:1.0:1787707163.004306:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1787707163.004332:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1787707163.004406:0:6918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa3acc9880 x1874546729692544/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787707178 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707163.004423:0:6918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6918:1874546729692544:0@lo:700: 00000004:02000040:0.0:1787707163.106780:0:6918:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1787707163.118922:0:6918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6918:1874546729692800:0@lo:5: 00000100:00100000:0.0:1787707163.118994:0:6918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707163.119835:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729692800 00000100:00100000:0.0:1787707163.119854:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729692800 00000100:00100000:0.0:1787707163.119903:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787707163.119913:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6918:x1874546729692800:12345-0@lo:5: 00000100:00100000:3.0:1787707163.127246:0:6918:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa30b2f3c0 going to sleep for 11 seconds 00002000:00080000:0.0:1787707163.142120:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787707163.142141:0:6690:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1787707163.154613:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6918:x1874546729692800:12345-0@lo:5: Request processed in 34692us (35610us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787707163.154627:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787707163.158544:0:6918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa3acc9c00 x1874546729692800/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787707179 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707163.158578:0:6918:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787707163.158594:0:6918:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8cfa3acc9c00 x1874546729692800/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787707179 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707163.158606:0:6918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6918:1874546729692800:0@lo:5: 00000004:00080000:2.0:1787707163.158621:0:6918:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787707163.896846:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707164.921543:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787707165.643486:0:7058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg446-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787707165.945657:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707166.978917:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707167.544731:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729693184:0@lo:400: 00000100:00100000:3.0:1787707167.544854:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729692928:0@lo:400: 00000100:00100000:3.0:1787707167.544934:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707167.545000:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787707167.545007:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729693312:0@lo:400: 00000100:00100000:3.0:1787707167.545062:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707167.545096:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729692928 00000100:00100000:3.0:1787707167.545103:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729692928 00000100:00100000:3.0:1787707167.545142:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787707167.545151:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa18a93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:3315:x1874546729692928:12345-0@lo:400: 00000100:00100000:3.0:1787707167.545197:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa18a93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:3315:x1874546729692928:12345-0@lo:400: Request processed in 47us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707167.545204:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787707167.545250:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729692928:0@lo:400: 00000100:00100000:1.0:1787707167.545544:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729693056:0@lo:400: 00000100:00100000:1.0:1787707167.545578:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707167.545620:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729693312 00000100:00100000:1.0:1787707167.545624:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729693312 00000100:00100000:1.0:1787707167.545663:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787707167.545681:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1874546729693312:12345-0@lo:400: 00000100:00100000:1.0:1787707167.545719:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1874546729693312:12345-0@lo:400: Request processed in 39us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707167.545725:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787707167.545771:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa0871e300 x1874546729693312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707167.545784:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729693312:0@lo:400: 00000100:00080000:1.0:1787707167.545813:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787707167.546526:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729693056 00000100:00100000:3.0:1787707167.546534:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729693056 00000100:00100000:3.0:1787707167.546578:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787707167.546586:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729693056:12345-0@lo:400: 00000100:00100000:3.0:1787707167.546644:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729693056:12345-0@lo:400: Request processed in 58us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707167.546651:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787707167.546779:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa0871ce00 x1874546729693056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707167.546792:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729693056:0@lo:400: 00000100:00100000:2.0:1787707167.547116:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707167.548680:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729693184 00000100:00100000:3.0:1787707167.548693:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729693184 00000100:00100000:3.0:1787707167.548971:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787707167.548981:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729693184:12345-0@lo:400: 00000100:00100000:3.0:1787707167.549094:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729693184:12345-0@lo:400: Request processed in 115us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707167.549102:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787707167.549274:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa0871fb80 x1874546729693184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707167.549303:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729693184:0@lo:400: 00000100:00080000:1.0:1787707167.550655:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787707167.992692:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707168.061696:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787707168.061729:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729693440:0@lo:13: 00000100:00100000:0.0:1787707168.061805:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707168.061879:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729693440 00000100:00100000:0.0:1787707168.061887:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729693440 00000100:00100000:0.0:1787707168.061935:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787707168.061945:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874546729693440:12345-0@lo:13: 00002000:00000024:0.0:1787707168.061981:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707168.062031:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874546729693440:12345-0@lo:13: Request processed in 87us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707168.062038:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787707168.062249:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa3acb6d80 x1874546729693440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707184 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707168.062271:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729693440:0@lo:13: 00000001:00080000:0.0:1787707168.149288:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787707169.028059:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707170.043097:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707171.067329:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707172.092473:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707172.665350:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729693824:0@lo:400: 00000100:00100000:1.0:1787707172.665610:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707172.665695:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787707172.665702:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729693952:0@lo:400: 00000100:00100000:1.0:1787707172.665730:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707172.665780:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729693824 00000100:00100000:1.0:1787707172.665790:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729693824 00000100:00100000:1.0:1787707172.665890:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787707172.665902:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729693824:12345-0@lo:400: 00000100:00100000:1.0:1787707172.665965:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729693824:12345-0@lo:400: Request processed in 65us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707172.665973:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1787707172.666004:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787707172.666045:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa3acce300 x1874546729693824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707172.666062:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729693824:0@lo:400: 00000100:00100000:0.0:1787707172.666926:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729693952 00000100:00100000:0.0:1787707172.666939:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729693952 00000100:00100000:2.0:1787707172.667135:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729693568:0@lo:400: 00000100:00100000:2.0:1787707172.667217:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707172.667268:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787707172.667276:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729693696:0@lo:400: 00000100:00100000:2.0:1787707172.667313:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707172.667350:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729693568 00000100:00100000:2.0:1787707172.667353:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729693568 00000100:00100000:2.0:1787707172.667420:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787707172.667432:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa18a91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:3316:x1874546729693568:12345-0@lo:400: 00000100:00100000:2.0:1787707172.667490:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa18a91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:3316:x1874546729693568:12345-0@lo:400: Request processed in 60us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707172.667499:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787707172.667560:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729693568:0@lo:400: 00000100:00100000:3.0:1787707172.667954:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729693696 00000100:00100000:3.0:1787707172.667966:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729693696 00000100:00100000:3.0:1787707172.668029:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787707172.668039:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729693696:12345-0@lo:400: 00000100:00100000:3.0:1787707172.668111:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729693696:12345-0@lo:400: Request processed in 74us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707172.668117:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787707172.668594:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787707172.668609:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729693952:12345-0@lo:400: 00000100:00100000:0.0:1787707172.668688:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729693952:12345-0@lo:400: Request processed in 85us (2956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707172.668695:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787707172.668747:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787707172.668783:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa3acced80 x1874546729693952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707172.668795:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787707172.668811:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729693952:0@lo:400: 00010000:00080000:2.0:1787707172.669713:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa3accf800 x1874546729693696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707172.669727:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729693696:0@lo:400: 00010000:00010000:3.0:1787707173.113488:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707173.183888:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729694080:0@lo:13: 00000100:00100000:2.0:1787707173.183994:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707173.184109:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729694080 00000100:00100000:2.0:1787707173.184119:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729694080 00000100:00100000:2.0:1787707173.184179:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787707173.184192:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729694080:12345-0@lo:13: 00002000:00000024:2.0:1787707173.184244:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707173.184316:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729694080:12345-0@lo:13: Request processed in 125us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707173.184325:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787707173.184395:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa0871f100 x1874546729694080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707173.184417:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729694080:0@lo:13: 00010000:00010000:3.0:1787707174.136520:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707175.161484:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707176.187014:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707177.219244:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707177.788961:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729694336:0@lo:400: 00000100:00100000:0.0:1787707177.789055:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707177.789114:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787707177.789121:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729694464:0@lo:400: 00000100:00100000:0.0:1787707177.789146:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707177.789203:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729694336 00000100:00100000:0.0:1787707177.789213:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729694336 00000100:00100000:0.0:1787707177.789262:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729694464 00000100:00100000:0.0:1787707177.789265:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729694464 00000100:00100000:0.0:1787707177.789296:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787707177.789306:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729694336:12345-0@lo:400: 00000100:00100000:0.0:1787707177.789360:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729694336:12345-0@lo:400: Request processed in 54us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707177.789367:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787707177.790105:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729694208:0@lo:400: 00000100:00100000:1.0:1787707177.790156:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707177.790214:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787707177.790224:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729694592:0@lo:400: 00000100:00100000:1.0:1787707177.790255:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707177.790301:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729694208 00000100:00100000:1.0:1787707177.790307:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729694208 00000100:00100000:1.0:1787707177.790341:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787707177.790349:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:3317:x1874546729694208:12345-0@lo:400: 00000100:00100000:3.0:1787707177.790536:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729694592 00000100:00100000:3.0:1787707177.790542:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729694592 00000100:00100000:3.0:1787707177.790653:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787707177.790661:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729694592:12345-0@lo:400: 00000100:00100000:1.0:1787707177.790723:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:3317:x1874546729694208:12345-0@lo:400: Request processed in 373us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707177.790731:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787707177.791131:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729694208:0@lo:400: 00000100:00100000:0.0:1787707177.791991:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787707177.792011:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729694464:12345-0@lo:400: 00000100:00100000:0.0:1787707177.796680:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729694464:12345-0@lo:400: Request processed in 4460us (7316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707177.796718:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1787707177.796772:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787707177.796783:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787707177.796829:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa3acc9180 x1874546729694464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707177.796848:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729694464:0@lo:400: 00010000:00080000:0.0:1787707177.796864:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa3acc8000 x1874546729694336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707177.796874:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729694336:0@lo:400: 00000100:00100000:3.0:1787707177.801446:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729694592:12345-0@lo:400: Request processed in 10776us (11179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707177.801461:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787707177.801712:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa3acc8e00 x1874546729694592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707177.801745:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729694592:0@lo:400: 00000020:01000004:2.0:1787707178.157457:0:7624:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787707178.157462:0:7624:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787707178.157607:0:7624:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cfa3f9b5800 00000020:01000004:2.0:1787707178.157623:0:7624:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787707178.157636:0:7624:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787707178.157660:0:7624:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cfa073d4d28) 00000020:00000080:2.0:1787707178.157676:0:7624:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787707178.208252:0:7624:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787707178.208604:0:7624:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00010000:00010000:3.0:1787707178.238727:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787707178.261915:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787707178.272621:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787707178.272652:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787707178.272778:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787707178.272800:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787707178.273247:0:7624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787707178.273260:0:7624:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787707178.273273:0:7624:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc5f18d5f94ec07e0 00000020:01000004:0.0:1787707178.273283:0:7624:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1787707178.274408:0:7624:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.146@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787707178.274414:0:7624:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787707178.274421:0:7624:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787707178.274447:0:7624:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1787707178.274451:0:7624:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.146@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000100:00100000:1.0:1787707178.296712:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787707178.296736:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729694720:0@lo:13: 00000100:00100000:1.0:1787707178.296806:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707178.297002:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729694720 00000100:00100000:2.0:1787707178.297022:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729694720 00000100:00100000:2.0:1787707178.297084:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787707178.297094:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729694720:12345-0@lo:13: 00002000:00000024:2.0:1787707178.297130:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707178.297190:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729694720:12345-0@lo:13: Request processed in 97us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707178.297197:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787707178.297241:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa0871f100 x1874546729694720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707178.297260:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729694720:0@lo:13: 00000040:01000000:1.0:1787707178.313203:0:7624:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.146@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787707178.313248:0:7624:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.146@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1787707178.313252:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787707178.313254:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787707178.313256:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787707178.313257:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787707178.313258:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787707178.313259:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787707178.313260:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787707178.313262:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787707178.313264:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787707178.313265:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787707178.313266:0:7624:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787707178.313270:0:7624:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1787707178.313272:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787707178.313273:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787707178.313274:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787707178.313275:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787707178.313276:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787707178.313277:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787707178.313278:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787707178.313279:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787707178.313280:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787707178.313281:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787707178.313282:0:7624:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787707178.313847:0:7624:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787707178.313867:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729694848:0@lo:253: 00000100:00100000:1.0:1787707178.314184:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707178.314285:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0734c540 going to sleep for 11 seconds 00000100:00100000:2.0:1787707178.318853:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729694848 00000100:00100000:2.0:1787707178.318872:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729694848 00000100:00100000:2.0:1787707178.319216:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787707178.319228:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:7624:x1874546729694848:12345-0@lo:253: 20000000:01000000:2.0:1787707178.319269:0:5850:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787707178.319273:0:5850:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1787707178.319279:0:5850:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1787707178.319282:0:5850:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1787707178.322893:0:5850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787707178.325770:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1787707178.325801:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1787707178.325869:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1787707178.325876:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1787707178.325900:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1787707178.326364:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1787707178.327918:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1787707178.328027:0:5850:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.146@tcp 20000000:01000000:2.0:1787707178.328029:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.146@tcp (null) (null) (null) 00000040:00080000:2.0:1787707178.328219:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1787707178.328236:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787707178.328366:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1787707178.328406:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.146@tcp (null) (null) 00000040:00080000:2.0:1787707178.328443:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1787707178.328452:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787707178.328484:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1787707178.328536:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1787707178.329859:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1787707178.329886:0:5850:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.146@tcp 20000000:01000000:2.0:1787707178.329889:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.146@tcp (null) (null) (null) 00000040:00080000:2.0:1787707178.329925:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787707178.333238:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787707178.333535:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787707178.333548:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.146@tcp (null) (null) 00000040:00080000:3.0:1787707178.333581:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787707178.333590:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787707178.333671:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787707178.333786:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787707178.333812:0:5850:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787707178.333816:0:5850:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787707178.333819:0:5850:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787707178.333833:0:5850:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787707178.333836:0:5850:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787707178.333881:0:5850:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787707178.333884:0:5850:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787707178.335067:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787707178.335158:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787707178.335221:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1787707178.335739:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1787707178.335786:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1787707178.335848:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1787707178.335862:0:5850:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787707178.335864:0:5850:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787707178.337361:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1787707178.337454:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1787707178.337521:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787707178.338853:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787707178.338899:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787707178.338945:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787707178.338959:0:5850:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787707178.338961:0:5850:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787707178.343198:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1787707178.343364:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1787707178.343766:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787707178.345230:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787707178.345284:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787707178.345642:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787707178.345660:0:5850:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787707178.345674:0:5850:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787707178.350213:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787707178.350763:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787707178.350814:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787707178.350887:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787707178.350904:0:5850:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1787707178.350906:0:5850:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1787707178.350914:0:5850:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787707178.350947:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec07e7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.350965:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa00030600/0xc5f18d5f94ec0738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0731 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.350973:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa013fc000/0xc5f18d5f94ec0762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec075b expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.350979:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa00030e00/0xc5f18d5f94ec078c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0785 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.350986:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa00030000/0xc5f18d5f94ec07a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec07a1 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.350991:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec07d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec07cb expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.350999:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec07e7 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.351037:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec07d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec07cb expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.351199:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec07d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec07cb expref: 16 pid: 5851 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707178.351233:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874546729694976:0@lo:104: 00000100:00100000:3.0:1787707178.351531:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787707178.351593:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa00030000/0xc5f18d5f94ec07a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec07a1 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.351602:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa00030000/0xc5f18d5f94ec07a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec07a1 expref: 16 pid: 5848 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707178.351612:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874546729695104:0@lo:104: 00010000:00010000:3.0:1787707178.351653:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa00030e00/0xc5f18d5f94ec078c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec0785 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.351662:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa00030e00/0xc5f18d5f94ec078c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0785 expref: 16 pid: 5848 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707178.351669:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874546729695232:0@lo:104: 00010000:00010000:3.0:1787707178.351788:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa013fc000/0xc5f18d5f94ec0762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec075b expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.351796:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa013fc000/0xc5f18d5f94ec0762 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec075b expref: 16 pid: 5850 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707178.351805:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874546729695360:0@lo:104: 00010000:00010000:3.0:1787707178.351825:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa00030600/0xc5f18d5f94ec0738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec0731 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.351833:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa00030600/0xc5f18d5f94ec0738 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0731 expref: 16 pid: 5850 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707178.351852:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874546729695488:0@lo:104: 00000100:00100000:3.0:1787707178.351880:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f3499c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707178.352003:0:5839:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787707178.352027:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707178.352252:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707178.352260:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707178.352267:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707178.352278:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729694976 00000100:00100000:1.0:1787707178.352285:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729694976 00000100:00100000:1.0:1787707178.352430:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729695104 00000100:00100000:1.0:1787707178.352434:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729695104 00000100:00100000:1.0:1787707178.352445:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729695232 00000100:00100000:1.0:1787707178.352448:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729695232 00000100:00100000:1.0:1787707178.352456:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729695360 00000100:00100000:1.0:1787707178.352458:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729695360 00000100:00100000:1.0:1787707178.352465:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729695488 00000100:00100000:1.0:1787707178.352467:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729695488 00000100:00100000:1.0:1787707178.352479:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787707178.352488:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa11073050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+7:5850:x1874546729694976:12345-0@lo:104: 00010000:00010000:1.0:1787707178.352503:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa00031200/0xc5f18d5f94ec07cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec07d2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.352563:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787707178.352569:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa11073050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+7:5850:x1874546729694976:12345-0@lo:104: Request processed in 82us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707178.352575:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787707178.352615:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787707178.352623:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+6:5850:x1874546729695104:12345-0@lo:104: 00010000:00010000:1.0:1787707178.352631:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec07a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec07a8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.352671:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787707178.352689:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+6:5850:x1874546729695104:12345-0@lo:104: Request processed in 56us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707178.352697:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787707178.352710:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787707178.352716:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+5:5850:x1874546729695232:12345-0@lo:104: 00010000:00010000:1.0:1787707178.352724:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec078c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.352750:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787707178.352755:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+5:5850:x1874546729695232:12345-0@lo:104: Request processed in 40us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707178.352761:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787707178.352774:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787707178.352779:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+4:5850:x1874546729695360:12345-0@lo:104: 00010000:00010000:1.0:1787707178.352786:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa00031e00/0xc5f18d5f94ec075b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0762 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.352811:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787707178.352815:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+4:5850:x1874546729695360:12345-0@lo:104: Request processed in 37us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707178.352820:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787707178.352831:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787707178.352837:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:5850:x1874546729695488:12345-0@lo:104: 00010000:00010000:1.0:1787707178.352843:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa00030c00/0xc5f18d5f94ec0731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0738 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.352875:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787707178.352880:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:5850:x1874546729695488:12345-0@lo:104: Request processed in 44us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707178.352886:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787707178.353001:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874546729694976:0@lo:104: 00000100:00100000:0.0:1787707178.353012:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874546729695104:0@lo:104: 00000100:00100000:0.0:1787707178.353019:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874546729695232:0@lo:104: 00000100:00100000:0.0:1787707178.353026:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874546729695360:0@lo:104: 00000100:00100000:0.0:1787707178.353033:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874546729695488:0@lo:104: 00010000:00010000:0.0:1787707178.353072:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec07e7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.353485:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787707178.353493:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa00031200/0xc5f18d5f94ec07cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec07d2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.353502:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa00031200 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:3.0:1787707178.353506:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa00031200/0xc5f18d5f94ec07cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec07d2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.353515:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa00031200/0xc5f18d5f94ec07cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec07d2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787707178.353522:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa00031200/0xc5f18d5f94ec07cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec07d2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787707178.353529:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787707178.353573:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa00031200/0xc5f18d5f94ec07cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec07d2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.353579:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787707178.353604:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa00031200/0xc5f18d5f94ec07cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec07d2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.353612:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa00031200/0xc5f18d5f94ec07cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec07d2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.353626:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787707178.353630:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec07a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec07a8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.353644:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fdc00 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:3.0:1787707178.353648:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec07a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec07a8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.353655:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec07a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec07a8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787707178.353661:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec07a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec07a8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787707178.353666:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787707178.353778:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec07a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec07a8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.353785:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787707178.353791:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec07a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec07a8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.353797:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec07a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec07a8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.353809:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787707178.353812:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec078c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.353818:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d5400 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:3.0:1787707178.353821:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec078c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.353837:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec078c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787707178.353843:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec078c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787707178.353849:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787707178.353905:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0785 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec078c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.353911:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787707178.353925:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0785 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec078c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.353943:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0785 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec078c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.353953:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787707178.353956:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa00031e00/0xc5f18d5f94ec075b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0762 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.353961:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa00031e00 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:3.0:1787707178.353964:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa00031e00/0xc5f18d5f94ec075b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec0762 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.353970:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa00031e00/0xc5f18d5f94ec075b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec0762 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787707178.353976:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa00031e00/0xc5f18d5f94ec075b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec0762 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787707178.353988:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787707178.354142:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729695616:0@lo:103: 00000100:00100000:1.0:1787707178.354202:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707178.354249:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787707178.354256:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729695744:0@lo:103: 00000100:00100000:1.0:1787707178.354275:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707178.354316:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729695616 00000100:00100000:1.0:1787707178.354322:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729695616 00010000:00010000:1.0:1787707178.354344:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec07d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec07cb expref: 17 pid: 5851 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707178.354364:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729695744 00000100:00100000:1.0:1787707178.354367:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729695744 00010000:00010000:1.0:1787707178.354400:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa00030000/0xc5f18d5f94ec07a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec07a1 expref: 18 pid: 5848 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707178.354413:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787707178.354420:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:3314:x1874546729695616:12345-0@lo:103: 00010000:00010000:1.0:1787707178.354430:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707178.354436:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec07d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec07cb expref: 18 pid: 5851 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.354446:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec07d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec07cb expref: 18 pid: 5851 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.354488:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec07d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec07cb expref: 18 pid: 5851 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.354501:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707178.354532:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:3314:x1874546729695616:12345-0@lo:103: Request processed in 113us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707178.354539:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787707178.354554:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787707178.354561:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:3314:x1874546729695744:12345-0@lo:103: 00010000:00010000:1.0:1787707178.354568:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707178.354572:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa00030000/0xc5f18d5f94ec07a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec07a1 expref: 16 pid: 5848 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.354580:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa00030000/0xc5f18d5f94ec07a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec07a1 expref: 16 pid: 5848 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.354589:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa00030000/0xc5f18d5f94ec07a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec07a1 expref: 16 pid: 5848 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.354598:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707178.354617:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:3314:x1874546729695744:12345-0@lo:103: Request processed in 58us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707178.354622:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787707178.354650:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729695744:0@lo:103: 00000100:00100000:1.0:1787707178.354658:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729695616:0@lo:103: 00010000:00010000:2.0:1787707178.358502:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787707178.360919:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707178.360926:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707178.360928:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707178.360987:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa00030c00/0xc5f18d5f94ec0731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0738 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.361021:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa00030c00 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:1.0:1787707178.361025:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa00030c00/0xc5f18d5f94ec0731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec0738 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.361036:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa00030c00/0xc5f18d5f94ec0731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec0738 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787707178.361058:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa00030c00/0xc5f18d5f94ec0731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec0738 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707178.361065:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787707178.361115:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa00030c00/0xc5f18d5f94ec0731 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0738 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.361121:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787707178.361134:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa00030c00/0xc5f18d5f94ec0731 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0738 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.361141:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa00030c00/0xc5f18d5f94ec0731 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0738 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.361154:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707178.361156:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707178.361158:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707178.362825:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa00031e00/0xc5f18d5f94ec075b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0762 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.362840:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787707178.362896:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729696128:0@lo:103: 00000100:00100000:1.0:1787707178.362983:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787707178.363114:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa00031e00/0xc5f18d5f94ec075b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0762 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.363123:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa00031e00/0xc5f18d5f94ec075b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0762 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.363143:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707178.363145:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707178.363147:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707178.363163:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729696000:0@lo:103: 00000100:00100000:3.0:1787707178.363205:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707178.363603:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787707178.363611:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729695872:0@lo:103: 00000100:00100000:3.0:1787707178.363634:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707178.363801:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729696128 00000100:00100000:2.0:1787707178.363809:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729696128 00010000:00010000:2.0:1787707178.363840:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa013fc000/0xc5f18d5f94ec0762 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec075b expref: 15 pid: 5850 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707178.363875:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729696000 00000100:00100000:2.0:1787707178.363879:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729696000 00010000:00010000:2.0:1787707178.363890:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa00030600/0xc5f18d5f94ec0738 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0731 expref: 16 pid: 5850 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707178.363906:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787707178.363914:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:3314:x1874546729696128:12345-0@lo:103: 00010000:00010000:2.0:1787707178.364012:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707178.364019:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa013fc000/0xc5f18d5f94ec0762 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec075b expref: 16 pid: 5850 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.364039:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa013fc000/0xc5f18d5f94ec0762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec075b expref: 16 pid: 5850 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.364153:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa013fc000/0xc5f18d5f94ec0762 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec075b expref: 16 pid: 5850 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.364180:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707178.364217:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:3314:x1874546729696128:12345-0@lo:103: Request processed in 304us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707178.364224:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787707178.364239:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787707178.364245:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:3317:x1874546729696000:12345-0@lo:103: 00010000:00010000:2.0:1787707178.364252:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707178.364257:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa00030600/0xc5f18d5f94ec0738 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0731 expref: 14 pid: 5850 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.364264:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa00030600/0xc5f18d5f94ec0738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0731 expref: 14 pid: 5850 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.364273:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa00030600/0xc5f18d5f94ec0738 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec0731 expref: 14 pid: 5850 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.364282:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707178.364389:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:3317:x1874546729696000:12345-0@lo:103: Request processed in 123us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707178.364395:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787707178.364557:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729696000:0@lo:103: 00000100:00100000:1.0:1787707178.364598:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729695872 00000100:00100000:1.0:1787707178.364603:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729695872 00010000:00010000:1.0:1787707178.364620:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa00030e00/0xc5f18d5f94ec078c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0785 expref: 13 pid: 5848 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707178.365453:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729696128:0@lo:103: 00000100:00100000:2.0:1787707178.369827:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787707178.369855:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:3317:x1874546729695872:12345-0@lo:103: 00010000:00010000:2.0:1787707178.369889:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707178.369899:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa00030e00/0xc5f18d5f94ec078c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0785 expref: 13 pid: 5848 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.369917:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa00030e00/0xc5f18d5f94ec078c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0785 expref: 13 pid: 5848 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.369949:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa00030e00/0xc5f18d5f94ec078c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec0785 expref: 13 pid: 5848 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.369968:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec07e7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.369976:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec07e7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.369994:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec07e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.370001:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec07e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.370008:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec07e7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.370016:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec07e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.370022:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fcc00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707178.370026:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec07e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.370226:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec07e7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.370259:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec07e7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.370271:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707178.370363:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:3317:x1874546729695872:12345-0@lo:103: Request processed in 522us (6726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707178.370394:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787707178.370493:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729695872:0@lo:103: 00010000:00010000:3.0:1787707178.370526:0:5850:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec07e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.370535:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec07e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.370547:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec07e7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787707178.370564:0:5850:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787707178.451514:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:7624:x1874546729694848:12345-0@lo:253: Request processed in 132281us (137331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707178.451528:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787707178.451595:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729694848:0@lo:253: 10000000:01000000:3.0:1787707178.451610:0:7624:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787707178.451613:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787707178.451615:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787707178.451616:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787707178.451617:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787707178.451619:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787707178.451620:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787707178.451621:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787707178.451623:0:7624:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787707178.451624:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787707178.451626:0:7624:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787707178.451645:0:7624:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cfa3f9b5800 from lustre-OST0001 10000000:01000000:3.0:1787707178.451668:0:7624:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787707178.451671:0:7624:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787707178.451679:0:7624:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cfa05848000 local copy 10000000:01000000:3.0:1787707178.451682:0:7624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787707178.451715:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fcc00/0xc5f18d5f94ec07ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.451726:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.146@tcp lock: ffff8cfa421fcc00/0xc5f18d5f94ec07ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.451736:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa421fcc00/0xc5f18d5f94ec07ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707178.451768:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729696256:0@lo:101: 00000100:00100000:3.0:1787707178.451802:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707178.451838:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f349f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787707178.451855:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729696256 00000100:00100000:3.0:1787707178.451861:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729696256 00000100:00100000:3.0:1787707178.451897:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787707178.451905:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+11:7624:x1874546729696256:12345-0@lo:101: 00010000:00010000:3.0:1787707178.451917:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707178.452096:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa421fdc00/0xc5f18d5f94ec07f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec07ee expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.452123:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa421fdc00/0xc5f18d5f94ec07f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec07ee expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.452133:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa421fdc00/0xc5f18d5f94ec07f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec07ee expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.452143:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fdc00, rc 0) 00000100:00100000:3.0:1787707178.452409:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:7624:x1874546729696256:12345-0@lo:101: Request processed in 503us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707178.452415:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787707178.455087:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729696256:0@lo:101: 00010000:00010000:0.0:1787707178.455118:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa421fcc00/0xc5f18d5f94ec07ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc5f18d5f94ec07f5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707178.455130:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fcc00/0xc5f18d5f94ec07ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc5f18d5f94ec07f5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707178.455273:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729696384:0@lo:501: 00000100:00100000:0.0:1787707178.455332:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707178.455402:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073ca840 going to sleep for 11 seconds 00000100:00100000:2.0:1787707178.456484:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729696384 00000100:00100000:2.0:1787707178.456494:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729696384 00000100:00100000:2.0:1787707178.456556:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787707178.456566:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:7624:x1874546729696384:12345-0@lo:501: 00000100:00100000:2.0:1787707178.456849:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:7624:x1874546729696384:12345-0@lo:501: Request processed in 284us (1516us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787707178.456858:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787707178.457244:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729696384:0@lo:501: 10000000:01000000:0.0:1787707178.457263:0:7624:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787707178.457295:0:7624:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787707178.457302:0:7624:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fcc00/0xc5f18d5f94ec07ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc5f18d5f94ec07f5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707178.457312:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fcc00/0xc5f18d5f94ec07ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc5f18d5f94ec07f5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707178.457327:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.146@tcp lock: ffff8cfa421fcc00/0xc5f18d5f94ec07ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc5f18d5f94ec07f5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707178.457342:0:7624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787707178.457366:0:7624:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cfa3f9b5800 10000000:01000000:0.0:1787707178.457396:0:7624:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787707178.457402:0:7624:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787707178.457405:0:7624:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787707178.457409:0:7624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787707178.457412:0:7624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787707178.457449:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3200/0xc5f18d5f94ec07fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707178.457457:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3200/0xc5f18d5f94ec07fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707178.457466:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3200/0xc5f18d5f94ec07fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707178.457483:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729696512:0@lo:101: 00000100:00100000:0.0:1787707178.457521:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707178.457557:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073caf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787707178.457639:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729696512 00000100:00100000:1.0:1787707178.457646:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729696512 00000100:00100000:1.0:1787707178.457694:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787707178.457702:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:7624:x1874546729696512:12345-0@lo:101: 00010000:00010000:1.0:1787707178.457712:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707178.457726:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa029d5a00/0xc5f18d5f94ec0803 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec07fc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.457747:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa029d5a00/0xc5f18d5f94ec0803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec07fc expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.457757:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa029d5a00/0xc5f18d5f94ec0803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec07fc expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.457767:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d5a00, rc 0) 00000100:00100000:1.0:1787707178.457799:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:7624:x1874546729696512:12345-0@lo:101: Request processed in 98us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707178.457804:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787707178.458404:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729696512:0@lo:101: 00010000:00010000:0.0:1787707178.458422:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3200/0xc5f18d5f94ec07fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0803 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707178.458430:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3200/0xc5f18d5f94ec07fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0803 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707178.458582:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729696640:0@lo:501: 00000100:00100000:0.0:1787707178.458613:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707178.458641:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073caf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787707178.458729:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729696640 00000100:00100000:1.0:1787707178.458735:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729696640 00000100:00100000:1.0:1787707178.458762:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787707178.458769:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:7624:x1874546729696640:12345-0@lo:501: 00000100:00100000:1.0:1787707178.459209:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:7624:x1874546729696640:12345-0@lo:501: Request processed in 440us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707178.459217:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:2.0:1787707178.459300:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787707178.459308:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa421fcc00/0xc5f18d5f94ec07ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc5f18d5f94ec07f5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.459315:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fcc00 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:2.0:1787707178.459319:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fcc00/0xc5f18d5f94ec07ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc5f18d5f94ec07f5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.459328:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa421fcc00/0xc5f18d5f94ec07ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc5f18d5f94ec07f5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787707178.459346:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fcc00/0xc5f18d5f94ec07ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc5f18d5f94ec07f5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707178.459352:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787707178.459406:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa421fcc00/0xc5f18d5f94ec07ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc5f18d5f94ec07f5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.459413:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787707178.459446:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fcc00/0xc5f18d5f94ec07ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc5f18d5f94ec07f5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.459453:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa421fcc00/0xc5f18d5f94ec07ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc5f18d5f94ec07f5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.459468:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707178.459470:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707178.459471:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707178.459484:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729696768:0@lo:103: 00000100:00100000:2.0:1787707178.459516:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707178.459560:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729696768 00000100:00100000:2.0:1787707178.459565:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729696768 00000100:00100000:2.0:1787707178.459597:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787707178.459604:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:3315:x1874546729696768:12345-0@lo:103: 00010000:00010000:2.0:1787707178.459615:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707178.459630:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa421fdc00/0xc5f18d5f94ec07f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f18d5f94ec07ee expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.459642:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707178.459680:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:3315:x1874546729696768:12345-0@lo:103: Request processed in 76us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707178.459890:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729696640:0@lo:501: 00000100:00100000:0.0:1787707178.459923:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729696896:0@lo:503: 00000100:00100000:2.0:1787707178.460021:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787707178.460164:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729696768:0@lo:103: 00000100:00100000:0.0:1787707178.462871:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707178.462968:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073caf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787707178.463141:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729696896 00000100:00100000:2.0:1787707178.463150:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729696896 00000100:00100000:2.0:1787707178.463242:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787707178.463254:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:7624:x1874546729696896:12345-0@lo:503: 00000100:00100000:2.0:1787707178.463516:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:7624:x1874546729696896:12345-0@lo:503: Request processed in 263us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707178.463524:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787707178.463619:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729696896:0@lo:503: 00000040:00080000:0.0:1787707178.463941:0:7624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787707178.464018:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729697024:0@lo:502: 00000100:00100000:0.0:1787707178.464072:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707178.468486:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073caf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787707178.468645:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729697024 00000100:00100000:1.0:1787707178.468655:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729697024 00000100:00100000:1.0:1787707178.468726:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787707178.468734:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:7624:x1874546729697024:12345-0@lo:502: 00000100:00100000:0.0:1787707178.469756:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:7624:x1874546729697024:12345-0@lo:502: Request processed in 1018us (5679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707178.469767:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787707178.471641:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729697024:0@lo:502: 00000040:00080000:0.0:1787707178.475652:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787707178.475817:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787707178.475885:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787707178.475952:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787707178.475990:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787707178.476021:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787707178.476199:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729697152:0@lo:502: 00000100:00100000:0.0:1787707178.476278:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707178.476417:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073ca600 going to sleep for 11 seconds 00000100:00100000:3.0:1787707178.476484:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729697152 00000100:00100000:3.0:1787707178.476491:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729697152 00000100:00100000:3.0:1787707178.476585:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787707178.476594:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:7624:x1874546729697152:12345-0@lo:502: 00000100:00100000:3.0:1787707178.476859:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:7624:x1874546729697152:12345-0@lo:502: Request processed in 265us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707178.476880:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787707178.477159:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729697152:0@lo:502: 00000040:00080000:0.0:1787707178.477309:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787707178.477321:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1787707178.478144:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787707178.478152:0:7633:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787707178.478158:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707178.478160:0:7633:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787707178.478165:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787707178.478191:0:7633:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cfa359f4d28) 00000020:00000080:0.0:1787707178.478210:0:7633:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787707178.478215:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787707178.478267:0:7633:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfa3f9b5800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787707178.478273:0:7633:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787707178.478290:0:7633:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc5f18d5f94ec0811 00010000:00010000:0.0:1787707178.486935:0:7633:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1787707178.487271:0:7633:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787707178.493357:0:7633:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787707178.493746:0:7633:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787707178.505815:0:7633:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787707178.506500:0:7633:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787707178.512508:0:7633:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787707178.512525:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787707178.512531:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707178.512533:0:7633:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787707178.512537:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787707178.512541:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707178.512542:0:7633:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787707178.512545:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787707178.512547:0:7633:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787707178.512611:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787707178.512614:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707178.512615:0:7633:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787707178.512618:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787707178.513037:0:7624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787707178.513134:0:7624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787707178.513157:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3200/0xc5f18d5f94ec07fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0803 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.513181:0:7624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3200/0xc5f18d5f94ec07fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0803 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707178.513190:0:7624:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfa3f9b5800 from 1 10000000:01000000:1.0:1787707178.513192:0:7624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787707178.513229:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0818 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.513237:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0818 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.513249:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0818 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707178.513273:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729697280:0@lo:101: 00000100:00100000:1.0:1787707178.513342:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707178.513462:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0734ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787707178.524825:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729697280 00000100:00100000:3.0:1787707178.524841:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729697280 00000100:00100000:3.0:1787707178.524910:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787707178.524920:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:7624:x1874546729697280:12345-0@lo:101: 00010000:00010000:3.0:1787707178.524947:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707178.524965:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa421fc800/0xc5f18d5f94ec081f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0818 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.524994:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa421fc800/0xc5f18d5f94ec081f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0818 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.525005:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa421fc800/0xc5f18d5f94ec081f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0818 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.525014:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fc800, rc 0) 00000100:00100000:3.0:1787707178.525110:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:7624:x1874546729697280:12345-0@lo:101: Request processed in 191us (11767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707178.525117:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787707178.525190:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729697280:0@lo:101: 00010000:00010000:3.0:1787707178.525208:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0818 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec081f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.525216:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0818 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec081f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707178.525326:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729697408:0@lo:501: 00000100:00100000:3.0:1787707178.525358:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707178.525419:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f349c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787707178.525434:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729697408 00000100:00100000:3.0:1787707178.525438:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729697408 00000100:00100000:3.0:1787707178.525462:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787707178.525467:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:7624:x1874546729697408:12345-0@lo:501: 00000100:00100000:3.0:1787707178.525699:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:7624:x1874546729697408:12345-0@lo:501: Request processed in 230us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707178.525705:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787707178.525737:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729697408:0@lo:501: 00000100:00100000:3.0:1787707178.525764:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729697536:0@lo:503: 00000100:00100000:3.0:1787707178.525803:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707178.525817:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f349c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787707178.525830:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729697536 00000100:00100000:3.0:1787707178.525834:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729697536 00000100:00100000:3.0:1787707178.525852:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787707178.525859:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:7624:x1874546729697536:12345-0@lo:503: 00000100:00100000:3.0:1787707178.526140:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:7624:x1874546729697536:12345-0@lo:503: Request processed in 280us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707178.526147:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787707178.526198:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729697536:0@lo:503: 00000040:00080000:3.0:1787707178.526509:0:7624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787707178.526582:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729697664:0@lo:502: 00000100:00100000:3.0:1787707178.526616:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707178.526635:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f349c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787707178.526649:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729697664 00000100:00100000:3.0:1787707178.526653:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729697664 00000100:00100000:3.0:1787707178.526672:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787707178.526685:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:7624:x1874546729697664:12345-0@lo:502: 00000100:00100000:3.0:1787707178.526823:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:7624:x1874546729697664:12345-0@lo:502: Request processed in 138us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707178.526830:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787707178.526869:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729697664:0@lo:502: 00000040:00080000:3.0:1787707178.527130:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787707178.527192:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787707178.527215:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729697792:0@lo:502: 00000100:00100000:3.0:1787707178.527248:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707178.527264:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f349c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787707178.527278:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729697792 00000100:00100000:3.0:1787707178.527282:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729697792 00000100:00100000:3.0:1787707178.527302:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787707178.527308:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:7624:x1874546729697792:12345-0@lo:502: 00000100:00100000:3.0:1787707178.527450:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:7624:x1874546729697792:12345-0@lo:502: Request processed in 142us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707178.527457:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787707178.527498:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729697792:0@lo:502: 00000040:00080000:3.0:1787707178.527571:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787707178.527579:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787707178.532126:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787707178.532140:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707178.532142:0:7637:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787707178.532150:0:7637:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfa3f9b5800 00000020:00000080:1.0:1787707178.532179:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787707178.532211:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787707178.532214:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707178.532215:0:7637:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787707178.532218:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787707178.538788:0:7624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787707178.538830:0:7624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787707178.539015:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0818 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec081f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.539028:0:7624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0818 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec081f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787707178.539120:0:7624:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787707178.539123:0:7624:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cfa3f9b5800 10000000:01000000:3.0:1787707178.539127:0:7624:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cfa3f9b5800 10000000:01000000:3.0:1787707178.539131:0:7624:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787707178.539138:0:7624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfa3f9b5800 from 1 10000000:01000000:3.0:1787707178.539141:0:7624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787707178.539189:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fca00/0xc5f18d5f94ec0826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.539198:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa421fca00/0xc5f18d5f94ec0826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707178.539209:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa421fca00/0xc5f18d5f94ec0826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707178.539233:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729697920:0@lo:101: 00000100:00100000:3.0:1787707178.539302:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707178.539475:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f349c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787707178.540219:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729697920 00000100:00100000:1.0:1787707178.540229:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729697920 00000100:00100000:2.0:1787707178.540543:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787707178.540555:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:7624:x1874546729697920:12345-0@lo:101: 00010000:00010000:2.0:1787707178.540569:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707178.540586:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa013fc000/0xc5f18d5f94ec082d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.540612:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa013fc000/0xc5f18d5f94ec082d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0826 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.540623:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa013fc000/0xc5f18d5f94ec082d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0826 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.540633:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa013fc000, rc 0) 00000100:00100000:2.0:1787707178.540709:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:7624:x1874546729697920:12345-0@lo:101: Request processed in 156us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707178.540716:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787707178.540794:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729697920:0@lo:101: 00010000:00010000:0.0:1787707178.540812:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa421fca00/0xc5f18d5f94ec0826 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec082d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707178.540821:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fca00/0xc5f18d5f94ec0826 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec082d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707178.540947:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729698048:0@lo:501: 00000100:00100000:0.0:1787707178.540981:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707178.541242:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073caf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787707178.541312:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729698048 00000100:00100000:3.0:1787707178.541318:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729698048 00000100:00100000:3.0:1787707178.541344:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787707178.541352:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:7624:x1874546729698048:12345-0@lo:501: 00000100:00100000:3.0:1787707178.541612:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:7624:x1874546729698048:12345-0@lo:501: Request processed in 260us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707178.541619:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787707178.541731:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729698048:0@lo:501: 00000100:00100000:0.0:1787707178.541760:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729698176:0@lo:503: 00000100:00100000:0.0:1787707178.541796:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707178.541816:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073caf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787707178.541828:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729698176 00000100:00100000:0.0:1787707178.541831:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729698176 00000100:00100000:0.0:1787707178.541850:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787707178.541855:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:7624:x1874546729698176:12345-0@lo:503: 00000100:00100000:0.0:1787707178.541995:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:7624:x1874546729698176:12345-0@lo:503: Request processed in 139us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707178.542001:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787707178.542032:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729698176:0@lo:503: 00000040:00080000:0.0:1787707178.542482:0:7624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787707178.542543:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729698304:0@lo:502: 00000100:00100000:0.0:1787707178.542578:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707178.542600:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073caf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787707178.542624:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729698304 00000100:00100000:0.0:1787707178.542629:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729698304 00000100:00100000:0.0:1787707178.542649:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787707178.542655:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:7624:x1874546729698304:12345-0@lo:502: 00000100:00100000:0.0:1787707178.542831:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:7624:x1874546729698304:12345-0@lo:502: Request processed in 174us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707178.542839:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787707178.542877:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729698304:0@lo:502: 00000040:00080000:0.0:1787707178.543361:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787707178.543454:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787707178.543490:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787707178.543550:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787707178.543591:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787707178.543637:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787707178.543669:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787707178.543776:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787707178.543826:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787707178.543862:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787707178.543896:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787707178.544189:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787707178.544226:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787707178.544256:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787707178.544296:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787707178.544325:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787707178.544355:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787707178.544489:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787707178.544530:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787707178.544563:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787707178.544624:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787707178.544664:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787707178.544921:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787707178.545159:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787707178.545215:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787707178.545252:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787707178.545305:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787707178.545341:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1787707178.545762:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787707178.545819:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1787707178.545850:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1787707178.545875:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1787707178.545904:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787707178.546037:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787707178.546147:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787707178.546213:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787707178.546249:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787707178.546297:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729698432:0@lo:502: 00000100:00100000:0.0:1787707178.546828:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707178.547143:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073caf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787707178.547193:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729698432 00000100:00100000:2.0:1787707178.547210:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729698432 00000100:00100000:2.0:1787707178.547298:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787707178.547308:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:7624:x1874546729698432:12345-0@lo:502: 00000100:00100000:2.0:1787707178.547582:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:7624:x1874546729698432:12345-0@lo:502: Request processed in 275us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707178.547590:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787707178.547691:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729698432:0@lo:502: 00000040:00080000:1.0:1787707178.547788:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1787707178.547801:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787707178.549291:0:7638:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787707178.549314:0:7638:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cf9022c19b8) 00000020:00000080:0.0:1787707178.549335:0:7638:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1787707178.549420:0:7638:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfa3f9b5800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787707178.549424:0:7638:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfa3f9b5800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787707178.549427:0:7638:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfa3f9b5800 3 00010000:00080000:0.0:1787707178.549458:0:7638:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfa06ea5800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.146@tcp at head 00010000:00010000:0.0:1787707178.551060:0:7638:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1787707178.560033:0:7638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787707178.560156:0:7638:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787707178.560179:0:7638:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc5f18d5f94ec083b 00000100:00080000:0.0:1787707178.560191:0:7638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787707178.560198:0:7638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cfa06ea5800 using connection 192.168.204.146@tcp/0@lo 00000100:00100000:0.0:1787707178.560262:0:7638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfa3acc9180 x1874546729698560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787707178.560302:0:7638:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787707178.560426:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729698688:0@lo:400: 00000100:00100000:0.0:1787707178.560495:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707178.560531:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787707178.560537:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729698816:0@lo:400: 00000100:00100000:0.0:1787707178.560575:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707178.560608:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729698688 00000100:00100000:0.0:1787707178.560614:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729698688 00000100:00100000:0.0:1787707178.560648:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729698816 00000100:00100000:0.0:1787707178.560651:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729698816 00000100:00100000:0.0:1787707178.560667:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787707178.560675:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729698688:12345-0@lo:400: 00000100:00100000:0.0:1787707178.560722:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729698688:12345-0@lo:400: Request processed in 47us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707178.560729:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787707178.560742:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787707178.560748:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729698816:12345-0@lo:400: 00000100:00100000:0.0:1787707178.560773:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729698816:12345-0@lo:400: Request processed in 26us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707178.560780:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787707178.560815:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa3accbb80 x1874546729698816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707178.560827:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729698816:0@lo:400: 00010000:00080000:0.0:1787707178.560837:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa3acc8000 x1874546729698688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707178.560856:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729698688:0@lo:400: 00000100:00100000:1.0:1787707178.561257:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874546729698560:0@lo:38: 00000100:00100000:1.0:1787707178.561294:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707178.561578:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729698560 00000100:00100000:0.0:1787707178.561584:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729698560 00000040:00080000:2.0:1787707178.561993:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:2.0:1787707178.562143:0:7640:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8cfa0871f100 x1874546729698944/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707178.562152:0:7640:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f258600 going to sleep for 0 seconds 00000100:00100000:0.0:1787707178.562314:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787707178.562322:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874546729698560:12345-0@lo:38: 00010000:00080000:0.0:1787707178.562346:0:5856:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:0.0:1787707178.562413:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc5f18d5f94ec0842 00000004:00100000:0.0:1787707178.562429:0:5856:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787707178.562860:0:5856:0:(import.c:65:import_set_state_nolock()) ffff8cfa419d1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787707178.562958:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874546729698560:12345-0@lo:38: Request processed in 633us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707178.562966:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787707178.563038:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa3acc9180 x1874546729698560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787707188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707178.563060:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787707178.563068:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787707178.563075:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787707178.563080:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787707178.563082:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cfa06ea5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787707178.563088:0:3313:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000027fb1878): req@ffff8cfa0871f100 x1874546729698944/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707178.563103:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874546729698560:0@lo:38: 00000100:00100000:2.0:1787707178.563163:0:7640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707178.563213:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729698944 00000100:00100000:2.0:1787707178.563219:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729698944 00000100:00100000:2.0:1787707178.563261:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787707178.563268:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7640:x1874546729698944:12345-0@lo:901: 00000100:00100000:2.0:1787707178.563667:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7640:x1874546729698944:12345-0@lo:901: Request processed in 399us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707178.563698:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787707178.563721:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787707178.563743:0:7640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa0871f100 x1874546729698944/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787707194 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707178.563754:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871f100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7640:1874546729698944:0@lo:901: 00000020:01000000:1.0:1787707178.566830:0:7624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787707178.566876:0:7624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787707178.566904:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fca00/0xc5f18d5f94ec0826 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec082d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.566916:0:7624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa421fca00/0xc5f18d5f94ec0826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec082d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787707178.567154:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787707178.567156:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787707178.567158:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787707178.567159:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787707178.567161:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787707178.567162:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787707178.567164:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787707178.567176:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787707178.567178:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787707178.567180:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787707178.567181:0:7624:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787707178.567185:0:7624:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1787707178.567193:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787707178.567194:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787707178.567195:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787707178.567197:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787707178.567198:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787707178.567199:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787707178.567200:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787707178.567200:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787707178.567201:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787707178.567202:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787707178.567203:0:7624:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787707178.567231:0:7624:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787707178.567250:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729699072:0@lo:253: 00000100:00100000:1.0:1787707178.567320:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707178.567729:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0734cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787707178.571014:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729699072 00000100:00100000:2.0:1787707178.571031:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729699072 00000100:00100000:2.0:1787707178.571223:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787707178.571234:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:7624:x1874546729699072:12345-0@lo:253: 20000000:01000000:2.0:1787707178.571268:0:5850:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787707178.571281:0:5850:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787707178.620110:0:5850:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787707178.620162:0:5850:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787707178.620264:0:5872:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787707178.620269:0:5872:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787707178.620292:0:5872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfa013fce00/0xc5f18d5f94ec0849 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.620311:0:5872:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec079a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0793 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.620320:0:5872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfa013fce00/0xc5f18d5f94ec0849 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.620463:0:5872:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec079a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec0793 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.620480:0:5872:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec079a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0793 expref: 14 pid: 5851 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707178.620496:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5872:1874546729699200:0@lo:104: 00000100:00100000:2.0:1787707178.621251:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707178.621398:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f258a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787707178.622616:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729699200 00000100:00100000:1.0:1787707178.622631:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729699200 00000100:00100000:1.0:1787707178.622698:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787707178.622708:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:5872:x1874546729699200:12345-0@lo:104: 00010000:00010000:1.0:1787707178.622726:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec0793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec079a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.622813:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787707178.622818:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:5872:x1874546729699200:12345-0@lo:104: Request processed in 114us (2242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707178.622825:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787707178.622849:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787707178.622854:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec0793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec079a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.622862:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4000 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:1.0:1787707178.622880:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec0793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec079a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.622890:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec0793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec079a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787707178.622898:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec0793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec079a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707178.622904:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787707178.622936:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec0793 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec079a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.622942:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787707178.622958:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec0793 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec079a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.622965:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4000/0xc5f18d5f94ec0793 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec079a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.622984:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707178.622986:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707178.622988:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707178.623001:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729699328:0@lo:103: 00000100:00100000:1.0:1787707178.623038:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707178.623319:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5872:1874546729699200:0@lo:104: 00010000:00010000:2.0:1787707178.623350:0:5872:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfa013fce00/0xc5f18d5f94ec0849 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707178.623532:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729699328 00000100:00100000:1.0:1787707178.623539:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729699328 00010000:00010000:1.0:1787707178.623562:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec079a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0793 expref: 15 pid: 5851 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707178.623583:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787707178.623598:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa05e67450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:3314:x1874546729699328:12345-0@lo:103: 00010000:00010000:1.0:1787707178.623609:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707178.623616:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec079a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0793 expref: 15 pid: 5851 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.623628:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec079a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0793 expref: 15 pid: 5851 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.623643:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec079a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec0793 expref: 15 pid: 5851 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.623660:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfa013fce00/0xc5f18d5f94ec0849 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.623668:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa013fce00/0xc5f18d5f94ec0849 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787707178.623695:0:5843:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003426627s 00010000:00010000:1.0:1787707178.623701:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa013fce00/0xc5f18d5f94ec0849 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.623709:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa013fce00/0xc5f18d5f94ec0849 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.623716:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfa013fce00/0xc5f18d5f94ec0849 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.623722:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfa013fce00/0xc5f18d5f94ec0849 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.623728:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa013fce00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:1.0:1787707178.623737:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfa013fce00/0xc5f18d5f94ec0849 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.623744:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfa013fce00/0xc5f18d5f94ec0849 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.623757:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfa013fce00/0xc5f18d5f94ec0849 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707178.623766:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707178.623805:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa05e67450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:3314:x1874546729699328:12345-0@lo:103: Request processed in 207us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707178.623812:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787707178.623861:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729699328:0@lo:103: 00010000:00010000:2.0:1787707178.624300:0:5872:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfa013fce00/0xc5f18d5f94ec0849 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.624309:0:5872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfa013fce00/0xc5f18d5f94ec0849 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707178.624315:0:5872:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa013fce00/0xc5f18d5f94ec0849 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707178.640550:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:7624:x1874546729699072:12345-0@lo:253: Request processed in 69308us (73219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707178.640565:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787707178.640773:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7624:1874546729699072:0@lo:253: 10000000:01000000:0.0:1787707178.640790:0:7624:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787707178.640794:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787707178.640795:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787707178.640797:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787707178.640798:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787707178.640799:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787707178.640800:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787707178.640802:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787707178.640804:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787707178.640805:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787707178.640807:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787707178.640808:0:7624:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787707178.640827:0:7624:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787707178.650017:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787707178.650495:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787707178.650808:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787707178.651037:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787707178.651519:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787707178.651754:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787707178.654346:0:7624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787707179.029130:0:7624:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787707179.029137:0:7624:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787707179.029183:0:7624:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787707179.029236:0:7624:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.146@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787707179.029250:0:7624:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787707179.029276:0:7624:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787707179.264168:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707180.282569:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707181.309828:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707182.333552:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707183.352638:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707183.417134:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787707183.417165:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729699456:0@lo:13: 00000100:00100000:1.0:1787707183.417241:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707183.417367:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729699456 00000100:00100000:2.0:1787707183.417403:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729699456 00000100:00100000:2.0:1787707183.417471:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787707183.417482:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729699456:12345-0@lo:13: 00002000:00000024:2.0:1787707183.417522:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707183.417575:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729699456:12345-0@lo:13: Request processed in 95us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707183.417583:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787707183.417638:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa0871f100 x1874546729699456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707183.417657:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729699456:0@lo:13: 00000100:00080000:1.0:1787707183.417728:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787707183.930675:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787707183.932406:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729699712:0@lo:400: 00000100:00100000:3.0:1787707183.932489:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707183.932553:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729699584:0@lo:400: 00000100:00100000:3.0:1787707183.932582:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707183.932723:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729699584 00000100:00100000:2.0:1787707183.932734:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729699584 00000100:00100000:2.0:1787707183.932784:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787707183.932794:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:3317:x1874546729699584:12345-0@lo:400: 00000100:00100000:2.0:1787707183.932846:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:3317:x1874546729699584:12345-0@lo:400: Request processed in 53us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707183.932853:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787707183.932900:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729699584:0@lo:400: 00000100:00100000:3.0:1787707183.936383:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729699712 00000100:00100000:3.0:1787707183.936400:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729699712 00000100:00100000:3.0:1787707183.936463:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787707183.936475:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729699712:12345-0@lo:400: 00000100:00100000:3.0:1787707183.936566:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729699712:12345-0@lo:400: Request processed in 94us (4077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707183.936572:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787707183.936777:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3accbb80 x1874546729699712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707183.936794:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729699712:0@lo:400: 00000100:00100000:0.0:1787707183.937012:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729699840:0@lo:400: 00000100:00100000:0.0:1787707183.937057:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707183.937109:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729699840 00000100:00100000:0.0:1787707183.937122:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729699840 00000100:00100000:0.0:1787707183.937161:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787707183.937167:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729699840:12345-0@lo:400: 00000100:00100000:0.0:1787707183.937204:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729699840:12345-0@lo:400: Request processed in 37us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707183.937211:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787707183.937228:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787707183.937247:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acc8e00 x1874546729699840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707183.937257:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729699840:0@lo:400: 00000100:00100000:0.0:1787707183.937289:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729699968:0@lo:400: 00000100:00100000:0.0:1787707183.937317:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707183.937345:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729699968 00000100:00100000:0.0:1787707183.937349:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729699968 00000100:00100000:0.0:1787707183.937397:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787707183.937404:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729699968:12345-0@lo:400: 00000100:00100000:0.0:1787707183.937439:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729699968:12345-0@lo:400: Request processed in 35us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707183.937444:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787707183.937457:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787707183.937474:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acc8e00 x1874546729699968/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707183.937484:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729699968:0@lo:400: 00010000:00010000:1.0:1787707184.377630:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707185.400822:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787707185.465316:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787707185.465325:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfa34ab9800 from 30 10000000:01000000:2.0:1787707185.465331:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787707185.465391:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc600/0xc5f18d5f94ec0850 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707185.465404:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc600/0xc5f18d5f94ec0850 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707185.465416:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc600/0xc5f18d5f94ec0850 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707185.465442:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729700096:0@lo:101: 00000100:00100000:2.0:1787707185.465523:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707185.465570:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1103b000 going to sleep for 11 seconds 00000100:00100000:1.0:1787707185.474004:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729700096 00000100:00100000:1.0:1787707185.474022:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729700096 00000100:00100000:1.0:1787707185.475246:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787707185.475262:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:5853:x1874546729700096:12345-0@lo:101: 00010000:00010000:1.0:1787707185.475280:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707185.475296:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa029d4600/0xc5f18d5f94ec0857 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0850 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707185.475330:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa029d4600/0xc5f18d5f94ec0857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0850 expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707185.475339:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa029d4600/0xc5f18d5f94ec0857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0850 expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707185.475348:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d4600, rc 0) 00000100:00100000:1.0:1787707185.475449:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:5853:x1874546729700096:12345-0@lo:101: Request processed in 192us (9926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707185.475455:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787707185.476017:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729700096:0@lo:101: 00010000:00010000:1.0:1787707185.476049:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc600/0xc5f18d5f94ec0850 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0857 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707185.476060:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc600/0xc5f18d5f94ec0850 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0857 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707185.478457:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729700224:0@lo:501: 00000100:00100000:1.0:1787707185.478535:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707185.478585:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073ca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787707185.478684:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729700224 00000100:00100000:2.0:1787707185.478692:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729700224 00000100:00100000:2.0:1787707185.478757:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787707185.478767:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:5853:x1874546729700224:12345-0@lo:501: 00000100:00100000:2.0:1787707185.479328:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:5853:x1874546729700224:12345-0@lo:501: Request processed in 562us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707185.479336:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787707185.479430:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729700224:0@lo:501: 00000100:00100000:3.0:1787707185.479536:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729700352:0@lo:503: 00000100:00100000:3.0:1787707185.479677:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707185.479726:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f25b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787707185.479810:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729700352 00000100:00100000:2.0:1787707185.479815:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729700352 00000100:00100000:2.0:1787707185.479843:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787707185.479850:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:5853:x1874546729700352:12345-0@lo:503: 00000100:00100000:2.0:1787707185.480213:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:5853:x1874546729700352:12345-0@lo:503: Request processed in 362us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707185.480220:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787707185.480282:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729700352:0@lo:503: 00000100:00100000:1.0:1787707185.482180:0:7928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7928:1874546729700480:0@lo:502: 00000100:00100000:1.0:1787707185.482254:0:7928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707185.482302:0:7928:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073ca900 going to sleep for 11 seconds 00000100:00100000:2.0:1787707185.482424:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729700480 00000100:00100000:2.0:1787707185.482431:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729700480 00000100:00100000:2.0:1787707185.482490:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787707185.482508:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:7928:x1874546729700480:12345-0@lo:502: 00000100:00100000:2.0:1787707185.482843:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:7928:x1874546729700480:12345-0@lo:502: Request processed in 343us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707185.482850:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787707185.485866:0:7928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7928:1874546729700480:0@lo:502: 00000100:00100000:1.0:1787707185.485953:0:7928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7928:1874546729700608:0@lo:502: 00000100:00100000:1.0:1787707185.486024:0:7928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707185.486082:0:7928:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073ca900 going to sleep for 11 seconds 00000100:00100000:2.0:1787707185.486356:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729700608 00000100:00100000:2.0:1787707185.486364:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729700608 00000100:00100000:2.0:1787707185.486456:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787707185.486467:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:7928:x1874546729700608:12345-0@lo:502: 00000100:00100000:2.0:1787707185.486716:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:7928:x1874546729700608:12345-0@lo:502: Request processed in 251us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707185.486724:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787707185.488435:0:7928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7928:1874546729700608:0@lo:502: 00000040:00080000:1.0:1787707185.488498:0:7928:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787707185.489798:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787707185.489831:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787707185.489843:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc600/0xc5f18d5f94ec0850 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0857 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707185.489855:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc600/0xc5f18d5f94ec0850 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0857 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787707185.489866:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787707185.489868:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787707185.489889:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787707185.490029:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec085e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707185.490086:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec085e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707185.490096:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec085e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707185.490182:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729700736:0@lo:101: 00000100:00100000:3.0:1787707185.490251:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707185.490294:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f25b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787707185.491050:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729700736 00000100:00100000:2.0:1787707185.491060:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729700736 00000100:00100000:2.0:1787707185.491122:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787707185.491133:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:5853:x1874546729700736:12345-0@lo:101: 00010000:00010000:2.0:1787707185.491152:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707185.491170:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa013fdc00/0xc5f18d5f94ec0865 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec085e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707185.491197:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa013fdc00/0xc5f18d5f94ec0865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec085e expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707185.491209:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa013fdc00/0xc5f18d5f94ec0865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec085e expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707185.491224:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa013fdc00, rc 0) 00000100:00100000:2.0:1787707185.491290:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:5853:x1874546729700736:12345-0@lo:101: Request processed in 159us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707185.491296:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787707185.491703:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729700736:0@lo:101: 00010000:00010000:3.0:1787707185.491720:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec085e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0865 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707185.491735:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec085e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0865 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707185.491806:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729700864:0@lo:501: 00000100:00100000:3.0:1787707185.491839:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707185.491917:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729700864 00000100:00100000:2.0:1787707185.491921:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729700864 00000100:00100000:2.0:1787707185.491947:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787707185.491953:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:5853:x1874546729700864:12345-0@lo:501: 00000100:00100000:2.0:1787707185.492199:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:5853:x1874546729700864:12345-0@lo:501: Request processed in 245us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707185.492207:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787707185.492228:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f25b300 going to sleep for 11 seconds 00000100:00100000:3.0:1787707185.492241:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729700864:0@lo:501: 00000100:00100000:3.0:1787707185.492269:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729700992:0@lo:503: 00000100:00100000:3.0:1787707185.492342:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707185.492363:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f25b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787707185.492404:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729700992 00000100:00100000:2.0:1787707185.492409:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729700992 00000100:00100000:2.0:1787707185.492505:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787707185.492514:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:5853:x1874546729700992:12345-0@lo:503: 00000100:00100000:2.0:1787707185.493003:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:5853:x1874546729700992:12345-0@lo:503: Request processed in 490us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707185.493011:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787707185.493097:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729700992:0@lo:503: 00000100:00100000:3.0:1787707185.493750:0:7929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7929:1874546729701120:0@lo:502: 00000100:00100000:3.0:1787707185.496134:0:7929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707185.496186:0:7929:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f25b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707185.496208:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729701120 00000100:00100000:1.0:1787707185.496216:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729701120 00000100:00100000:1.0:1787707185.496276:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787707185.496286:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:7929:x1874546729701120:12345-0@lo:502: 00000100:00100000:1.0:1787707185.496643:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:7929:x1874546729701120:12345-0@lo:502: Request processed in 358us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707185.496652:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787707185.497020:0:7929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7929:1874546729701120:0@lo:502: 00000020:01000000:3.0:1787707185.497067:0:7929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787707185.497076:0:7929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787707185.497079:0:7929:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787707185.497083:0:7929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787707185.497085:0:7929:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787707185.497114:0:7929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7929:1874546729701248:0@lo:502: 00000100:00100000:3.0:1787707185.497153:0:7929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707185.497188:0:7929:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f25b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707185.497414:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729701248 00000100:00100000:1.0:1787707185.497419:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729701248 00000100:00100000:1.0:1787707185.497610:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787707185.497619:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:7929:x1874546729701248:12345-0@lo:502: 00000100:00100000:1.0:1787707185.497915:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:7929:x1874546729701248:12345-0@lo:502: Request processed in 297us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707185.497923:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787707185.497986:0:7929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7929:1874546729701248:0@lo:502: 00000020:01000000:3.0:1787707185.498008:0:7929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787707185.498013:0:7929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787707185.498015:0:7929:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787707185.498018:0:7929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1787707185.498212:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1787707185.498232:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787707185.498242:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec085e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0865 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707185.498265:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec085e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0865 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707185.498275:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787707185.498278:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfa02b55800 from 30 10000000:01000000:1.0:1787707185.498281:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787707185.498310:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5000/0xc5f18d5f94ec086c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707185.498318:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5000/0xc5f18d5f94ec086c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707185.498327:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5000/0xc5f18d5f94ec086c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707185.498343:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729701376:0@lo:101: 00000100:00100000:1.0:1787707185.498436:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707185.498462:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073ca300 going to sleep for 11 seconds 00000100:00100000:3.0:1787707185.498542:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729701376 00000100:00100000:3.0:1787707185.498548:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729701376 00000100:00100000:3.0:1787707185.498579:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787707185.498587:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:5853:x1874546729701376:12345-0@lo:101: 00010000:00010000:3.0:1787707185.498598:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707185.498611:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec0873 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec086c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707185.498633:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec0873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec086c expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707185.498656:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec0873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec086c expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707185.498666:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fda00, rc 0) 00000100:00100000:3.0:1787707185.498706:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:5853:x1874546729701376:12345-0@lo:101: Request processed in 119us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707185.498712:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787707185.498751:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729701376:0@lo:101: 00010000:00010000:1.0:1787707185.498826:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5000/0xc5f18d5f94ec086c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0873 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707185.498836:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5000/0xc5f18d5f94ec086c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0873 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707185.498880:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729701504:0@lo:501: 00000100:00100000:1.0:1787707185.498908:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707185.498937:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073ca300 going to sleep for 11 seconds 00000100:00100000:2.0:1787707185.499360:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729701504 00000100:00100000:2.0:1787707185.499366:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729701504 00000100:00100000:2.0:1787707185.499418:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787707185.499426:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:5853:x1874546729701504:12345-0@lo:501: 00000100:00100000:2.0:1787707185.500464:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:5853:x1874546729701504:12345-0@lo:501: Request processed in 1034us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707185.500475:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787707185.501022:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729701504:0@lo:501: 00000100:00100000:3.0:1787707185.501081:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729701632:0@lo:503: 00000100:00100000:3.0:1787707185.501131:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707185.501172:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f25b000 going to sleep for 11 seconds 00000100:00100000:2.0:1787707185.501514:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729701632 00000100:00100000:2.0:1787707185.501529:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729701632 00000100:00100000:2.0:1787707185.501576:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787707185.501585:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:5853:x1874546729701632:12345-0@lo:503: 00000100:00100000:2.0:1787707185.502242:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:5853:x1874546729701632:12345-0@lo:503: Request processed in 657us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707185.502251:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787707185.502305:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729701632:0@lo:503: 00000100:00100000:2.0:1787707185.504026:0:7930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7930:1874546729701760:0@lo:502: 00000100:00100000:2.0:1787707185.504103:0:7930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707185.504146:0:7930:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41fe0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787707185.504197:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729701760 00000100:00100000:3.0:1787707185.504203:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729701760 00000100:00100000:3.0:1787707185.504277:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787707185.504286:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:7930:x1874546729701760:12345-0@lo:502: 00000100:00100000:3.0:1787707185.505109:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:7930:x1874546729701760:12345-0@lo:502: Request processed in 822us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707185.505119:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787707185.505188:0:7930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7930:1874546729701760:0@lo:502: 00000100:00100000:1.0:1787707185.505243:0:7930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7930:1874546729701888:0@lo:502: 00000100:00100000:1.0:1787707185.505279:0:7930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707185.505344:0:7930:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073caf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787707185.505807:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729701888 00000100:00100000:3.0:1787707185.505814:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729701888 00000100:00100000:3.0:1787707185.505856:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787707185.505864:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:7930:x1874546729701888:12345-0@lo:502: 00000100:00100000:3.0:1787707185.506058:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:7930:x1874546729701888:12345-0@lo:502: Request processed in 194us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707185.506076:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787707185.506259:0:7930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7930:1874546729701888:0@lo:502: 00000040:00080000:1.0:1787707185.506287:0:7930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787707185.506776:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787707185.506798:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787707185.506809:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5000/0xc5f18d5f94ec086c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0873 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707185.506821:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5000/0xc5f18d5f94ec086c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0873 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787707185.506830:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787707185.506833:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfa02b55800 from 5 10000000:01000000:3.0:1787707185.506836:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787707185.506865:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc400/0xc5f18d5f94ec087a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707185.506873:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc400/0xc5f18d5f94ec087a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707185.506883:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc400/0xc5f18d5f94ec087a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707185.506899:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729702016:0@lo:101: 00000100:00100000:3.0:1787707185.506938:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707185.506976:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f25b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707185.507061:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729702016 00000100:00100000:1.0:1787707185.507067:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729702016 00000100:00100000:1.0:1787707185.507104:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787707185.507111:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:5853:x1874546729702016:12345-0@lo:101: 00010000:00010000:1.0:1787707185.507122:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707185.507137:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa029d5800/0xc5f18d5f94ec0881 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec087a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707185.507158:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa029d5800/0xc5f18d5f94ec0881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec087a expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707185.507167:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa029d5800/0xc5f18d5f94ec0881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec087a expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707185.507176:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d5800, rc 0) 00000100:00100000:1.0:1787707185.507206:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729702016:12345-0@lo:101: Request processed in 96us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707185.507211:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787707185.507277:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729702016:0@lo:101: 00010000:00010000:3.0:1787707185.507290:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc400/0xc5f18d5f94ec087a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0881 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707185.507396:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc400/0xc5f18d5f94ec087a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0881 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707185.507444:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729702144:0@lo:256: 00000100:00100000:3.0:1787707185.507473:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707185.507493:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f25b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707185.507568:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729702144 00000100:00100000:1.0:1787707185.507573:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729702144 00000100:00100000:1.0:1787707185.507598:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787707185.507612:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07314450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729702144:12345-0@lo:256: 20000000:01000000:1.0:1787707185.507624:0:5851:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787707185.507638:0:5851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787707185.507641:0:5851:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787707185.507706:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07314450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729702144:12345-0@lo:256: Request processed in 95us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707185.507713:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787707185.507782:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729702144:0@lo:256: 10000000:01000000:3.0:1787707185.507819:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787707185.507824:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc400/0xc5f18d5f94ec087a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0881 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707185.507831:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc400/0xc5f18d5f94ec087a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0881 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787707185.507837:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787707185.507839:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1787707185.507841:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787707185.507856:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd600/0xc5f18d5f94ec0888 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707185.507862:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd600/0xc5f18d5f94ec0888 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707185.507868:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd600/0xc5f18d5f94ec0888 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707185.507878:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729702272:0@lo:101: 00000100:00100000:3.0:1787707185.507909:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707185.508191:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729702272 00000100:00100000:3.0:1787707185.508196:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f25b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707185.508196:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729702272 00000100:00100000:1.0:1787707185.508222:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787707185.508229:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07316850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729702272:12345-0@lo:101: 00010000:00010000:1.0:1787707185.508236:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707185.508245:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa029d4e00/0xc5f18d5f94ec088f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0888 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707185.508262:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa029d4e00/0xc5f18d5f94ec088f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0888 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707185.508270:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa029d4e00/0xc5f18d5f94ec088f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0888 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707185.508276:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d4e00, rc 0) 00000100:00100000:1.0:1787707185.508411:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07316850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729702272:12345-0@lo:101: Request processed in 182us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707185.508418:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787707185.508452:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729702272:0@lo:101: 00010000:00010000:3.0:1787707185.508470:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd600/0xc5f18d5f94ec0888 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec088f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707185.508478:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd600/0xc5f18d5f94ec0888 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec088f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707185.508520:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729702400:0@lo:501: 00000100:00100000:3.0:1787707185.508545:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707185.508577:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f25b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707185.508606:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729702400 00000100:00100000:1.0:1787707185.508610:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729702400 00000100:00100000:1.0:1787707185.508637:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787707185.508645:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07314050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729702400:12345-0@lo:501: 00000100:00100000:1.0:1787707185.508908:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07314050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729702400:12345-0@lo:501: Request processed in 263us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707185.508916:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787707185.508929:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729702400:0@lo:501: 00000100:00100000:3.0:1787707185.508954:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729702528:0@lo:503: 00000100:00100000:3.0:1787707185.508999:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707185.509023:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f25b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707185.509076:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729702528 00000100:00100000:1.0:1787707185.509080:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729702528 00000100:00100000:3.0:1787707185.509140:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787707185.509149:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07316050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729702528:12345-0@lo:503: 00000100:00100000:3.0:1787707185.509603:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07316050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729702528:12345-0@lo:503: Request processed in 455us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707185.509610:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787707185.509693:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729702528:0@lo:503: 00000100:00100000:2.0:1787707185.510127:0:7931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7931:1874546729702656:0@lo:502: 00000100:00100000:2.0:1787707185.510168:0:7931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707185.510208:0:7931:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41fe0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787707185.510261:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729702656 00000100:00100000:1.0:1787707185.510267:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729702656 00000100:00100000:1.0:1787707185.510304:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787707185.510312:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:7931:x1874546729702656:12345-0@lo:502: 00000100:00100000:1.0:1787707185.510803:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:7931:x1874546729702656:12345-0@lo:502: Request processed in 491us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707185.510811:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787707185.510849:0:7931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7931:1874546729702656:0@lo:502: 00000020:01000000:3.0:1787707185.510877:0:7931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787707185.510885:0:7931:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787707185.510891:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787707185.510893:0:7931:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787707185.510897:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787707185.510901:0:7931:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.146@tcp to nid 0x20000c0a8cc92 (192.168.204.146@tcp) 00000020:01000000:3.0:1787707185.510923:0:7931:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787707185.510933:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787707185.510957:0:7931:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cfa058ab370) 00000020:00000080:3.0:1787707185.510977:0:7931:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787707185.510983:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787707185.511065:0:7931:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787707185.511070:0:7931:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787707185.511078:0:7931:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f18d5f94ec089d 00010000:00080000:3.0:1787707185.511112:0:7931:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf9012d6000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.146@tcp at head 00010000:00010000:3.0:1787707185.511331:0:7931:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1787707185.511866:0:7931:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787707185.511879:0:7931:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787707185.512958:0:7931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787707185.513206:0:7931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787707185.513259:0:7931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787707185.513320:0:7931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787707185.514083:0:7932:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787707185.514088:0:7932:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787707185.516694:0:7931:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787707185.516709:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787707185.516748:0:7931:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787707185.516782:0:7931:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f18d5f94ec08a4 00000100:00080000:2.0:1787707185.516793:0:7931:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787707185.516799:0:7931:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cf9012d6000 using connection 192.168.204.146@tcp/0@lo 00000100:00100000:2.0:1787707185.516835:0:7931:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfa0871ea00 x1874546729702784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787707185.516873:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729702784:0@lo:8: 00000100:00100000:2.0:1787707185.516962:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787707185.517029:0:7931:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787707185.517103:0:7931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787707185.517108:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707185.517110:0:7931:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787707185.517114:0:7931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787707185.517118:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707185.517120:0:7931:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787707185.517123:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787707185.517125:0:7931:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787707185.517144:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729702784 00000100:00100000:0.0:1787707185.517153:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729702784 00000100:00100000:2.0:1787707185.517157:0:7931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7931:1874546729702912:0@lo:502: 00000100:00100000:0.0:1787707185.517207:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787707185.517215:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3313:x1874546729702784:12345-0@lo:8: 00000100:00100000:2.0:1787707185.517220:0:7931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707185.517239:0:7931:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41fe0540 going to sleep for 11 seconds 00010000:00080000:0.0:1787707185.517245:0:6690:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:0.0:1787707185.517273:0:6690:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f18d5f94ec08ab 00002000:00100000:0.0:1787707185.517289:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cfa419d3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:3.0:1787707185.517293:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729702912 00002000:00080000:0.0:1787707185.517294:0:6690:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000100:00100000:3.0:1787707185.517301:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729702912 00000001:00000004:0.0:1787707185.517301:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1787707185.517351:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787707185.517360:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:7931:x1874546729702912:12345-0@lo:502: 00002000:00100000:0.0:1787707185.517445:0:6690:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787707185.517614:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787707185.517638:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8cfa419d6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787707185.517703:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874546729702784:12345-0@lo:8: Request processed in 487us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707185.517711:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787707185.517849:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa0871ea00 x1874546729702784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787707195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707185.517861:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787707185.517869:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787707185.517876:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:0.0:1787707185.517882:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729703040:0@lo:400: 00000100:00080000:2.0:1787707185.517895:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787707185.517899:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cf9012d6000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787707185.517914:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787707185.517920:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729702784:0@lo:8: 00000100:00100000:0.0:1787707185.517936:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787707185.517950:0:7932:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1787707185.517956:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:7931:x1874546729702912:12345-0@lo:502: Request processed in 598us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707185.517964:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787707185.517975:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787707185.517984:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729703168:0@lo:400: 00000100:00100000:0.0:1787707185.518016:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707185.518062:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729703296:0@lo:400: 00000004:00080000:2.0:1787707185.518063:0:7932:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 236564692121ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787707185.525170:0:7931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:7931:1874546729702912:0@lo:502: 00000020:01000000:2.0:1787707185.525282:0:7931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787707185.525291:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707185.525294:0:7931:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787707185.525301:0:7931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1787707185.525826:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729703040 00000100:00100000:3.0:1787707185.525835:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729703040 00000100:00100000:3.0:1787707185.526158:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729703168 00000100:00100000:3.0:1787707185.526163:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729703168 00000100:00100000:3.0:1787707185.526214:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787707185.526225:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729703040:12345-0@lo:400: 00000100:00100000:3.0:1787707185.526331:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729703040:12345-0@lo:400: Request processed in 108us (8396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707185.526540:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787707185.527704:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707185.527758:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787707185.527771:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729703424:0@lo:400: 00000100:00100000:0.0:1787707185.527807:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707185.527882:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729703296 00000100:00100000:2.0:1787707185.527902:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729703296 00000100:00100000:2.0:1787707185.527952:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787707185.527963:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729703296:12345-0@lo:400: 00000100:00100000:2.0:1787707185.528017:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729703296:12345-0@lo:400: Request processed in 58us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707185.528024:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787707185.528925:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729703424 00000100:00100000:3.0:1787707185.528932:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729703424 00000100:00100000:3.0:1787707185.528963:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787707185.528973:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729703168:12345-0@lo:400: 00000100:00100000:3.0:1787707185.529028:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729703168:12345-0@lo:400: Request processed in 57us (11011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707185.529048:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787707185.529070:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787707185.529078:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729703424:12345-0@lo:400: 00010000:00080000:0.0:1787707185.529104:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acc8000 x1874546729703296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707185.529114:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729703424:12345-0@lo:400: Request processed in 35us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707185.529122:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787707185.529125:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729703296:0@lo:400: 00000100:00080000:3.0:1787707185.529150:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787707185.529156:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787707185.529179:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3accbb80 x1874546729703168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707185.529189:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729703168:0@lo:400: 00010000:00080000:3.0:1787707185.529216:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acc8e00 x1874546729703040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707185.529224:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729703040:0@lo:400: 00010000:00080000:0.0:1787707185.529303:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acc9180 x1874546729703424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707185.529315:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729703424:0@lo:400: 00000020:01000000:1.0:1787707185.534547:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1787707185.534581:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787707185.534592:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd600/0xc5f18d5f94ec0888 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec088f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707185.534603:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd600/0xc5f18d5f94ec0888 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec088f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707185.534613:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787707185.534616:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cfa05848000 from 1 10000000:01000000:1.0:1787707185.534618:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787707185.534658:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4200/0xc5f18d5f94ec08b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707185.534713:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4200/0xc5f18d5f94ec08b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707185.534732:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4200/0xc5f18d5f94ec08b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707185.534756:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729703552:0@lo:101: 00000100:00100000:1.0:1787707185.534825:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707185.534873:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1040f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787707185.537135:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729703552 00000100:00100000:3.0:1787707185.537149:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729703552 00000100:00100000:3.0:1787707185.537263:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787707185.537275:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07314850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729703552:12345-0@lo:101: 00010000:00010000:3.0:1787707185.537307:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707185.537325:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa421fdc00/0xc5f18d5f94ec08b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec08b2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707185.537428:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa421fdc00/0xc5f18d5f94ec08b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec08b2 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707185.537440:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa421fdc00/0xc5f18d5f94ec08b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec08b2 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707185.537450:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fdc00, rc 0) 00000100:00100000:3.0:1787707185.537529:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07314850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:5853:x1874546729703552:12345-0@lo:101: Request processed in 256us (2703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707185.537535:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787707185.538088:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729703552:0@lo:101: 00010000:00010000:1.0:1787707185.538109:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4200/0xc5f18d5f94ec08b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec08b9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707185.538120:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4200/0xc5f18d5f94ec08b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec08b9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707185.538255:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729703680:0@lo:501: 00000100:00100000:1.0:1787707185.538293:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707185.538329:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1040f840 going to sleep for 11 seconds 00000100:00100000:1.0:1787707185.538442:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729703680 00000100:00100000:1.0:1787707185.538448:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729703680 00000100:00100000:1.0:1787707185.538478:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787707185.538487:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07316450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:5853:x1874546729703680:12345-0@lo:501: 00000100:00100000:1.0:1787707185.539102:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07316450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:5853:x1874546729703680:12345-0@lo:501: Request processed in 614us (805us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787707185.539111:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787707185.539281:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729703680:0@lo:501: 10000000:01000000:3.0:1787707185.539314:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787707185.539322:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4200/0xc5f18d5f94ec08b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec08b9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707185.539331:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4200/0xc5f18d5f94ec08b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec08b9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787707185.583353:0:7933:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787707185.583414:0:7933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7933:1874546729703936:0@lo:7: 00000100:00100000:3.0:1787707185.583503:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707185.583530:0:7933:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f25b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787707185.583548:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729703808:0@lo:13: 00000100:00100000:3.0:1787707185.583586:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787707185.583782:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1787707185.583831:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729703936 00000100:00100000:0.0:1787707185.583839:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729703936 00000100:00100000:0.0:1787707185.583893:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787707185.583903:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7933:x1874546729703936:12345-0@lo:7: 00000100:00080000:1.0:1787707185.590910:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1787707185.594019:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787707185.594027:0:6690:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787707185.594143:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7933:x1874546729703936:12345-0@lo:7: Request processed in 10238us (10637us total) trans 0 rc 0/0 00010000:00080000:1.0:1787707185.594284:0:7933:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acb7100 x1874546729703936/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787707201 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707185.594317:0:7933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7933:1874546729703936:0@lo:7: 00000004:00080000:1.0:1787707185.594329:0:7933:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787707185.594367:0:7933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7933:1874546729704064:0@lo:5: 00000100:00100000:1.0:1787707185.594426:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707185.594457:0:7933:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f2586c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707185.594528:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787707185.594555:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729704064 00000100:00100000:0.0:1787707185.594562:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729704064 00000100:00100000:0.0:1787707185.594604:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787707185.594612:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7933:x1874546729704064:12345-0@lo:5: 00002000:00080000:0.0:1787707185.594762:0:6690:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787707185.594766:0:6690:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787707185.595437:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729703808 00000100:00100000:2.0:1787707185.595444:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729703808 00000100:00100000:2.0:1787707185.595488:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787707185.595495:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3316:x1874546729703808:12345-0@lo:13: 00002000:00000024:2.0:1787707185.595514:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787707185.595556:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3316:x1874546729703808:12345-0@lo:13: Request processed in 61us (11969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707185.595562:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787707185.595617:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acb4a80 x1874546729703808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707185.595772:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729703808:0@lo:13: 00000100:00100000:0.0:1787707185.597046:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7933:x1874546729704064:12345-0@lo:5: Request processed in 2419us (2603us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787707185.597058:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787707185.597121:0:7933:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acced80 x1874546729704064/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787707201 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707185.597135:0:7933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7933:1874546729704064:0@lo:5: 00000004:00080000:0.0:1787707185.597148:0:7933:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787707185.597207:0:7933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3f910700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7933:1874546729704192:0@lo:700: 00000100:00100000:0.0:1787707185.597256:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707185.597275:0:7933:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3cbd5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787707185.597479:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729704192 00000100:00100000:1.0:1787707185.597487:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729704192 00000100:00100000:1.0:1787707185.597535:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787707185.597544:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7933:x1874546729704192:12345-0@lo:700: 00000100:00100000:1.0:1787707185.597576:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6696:1874546729704320:0@lo:700: 00000100:00100000:1.0:1787707185.597605:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707185.597623:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f258f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787707185.597638:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729704320 00000100:00100000:1.0:1787707185.597642:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729704320 00000100:00100000:1.0:1787707185.597671:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787707185.597677:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6696:x1874546729704320:12345-0@lo:700: 40000000:02000000:0.0:1787707185.684801:0:5863:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1787707185.696604:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6696:x1874546729704320:12345-0@lo:700: Request processed in 98917us (98988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707185.696618:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787707185.699915:0:6696:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3accc000 x1874546729704320/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787707201 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707185.699936:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6696:1874546729704320:0@lo:700: 40000000:02000000:1.0:1787707185.699951:0:6696:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1787707185.891116:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7933:x1874546729704192:12345-0@lo:700: Request processed in 293564us (293851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707185.891131:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:1.0:1787707185.891180:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1787707185.891205:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1787707185.891457:0:7933:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3f910700 x1874546729704192/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787707201 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707185.891472:0:7933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3f910700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7933:1874546729704192:0@lo:700: 00000004:02000040:0.0:1787707185.984891:0:7933:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1787707185.998996:0:7933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3f910700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7933:1874546729704448:0@lo:5: 00000100:00100000:0.0:1787707185.999080:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707185.999261:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729704448 00000100:00100000:2.0:1787707185.999270:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729704448 00000100:00100000:2.0:1787707185.999322:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787707185.999331:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7933:x1874546729704448:12345-0@lo:5: 00000100:00100000:0.0:1787707186.000253:0:7933:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3cbd5600 going to sleep for 11 seconds 00002000:00080000:2.0:1787707186.038366:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787707186.038728:0:6689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1787707186.053946:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7933:x1874546729704448:12345-0@lo:5: Request processed in 54604us (54855us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787707186.053962:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787707186.056266:0:7933:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3f910700 x1874546729704448/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787707201 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707186.056284:0:7933:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787707186.056301:0:7933:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8cfa3f910700 x1874546729704448/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787707201 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707186.056312:0:7933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3f910700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7933:1874546729704448:0@lo:5: 00000004:00080000:0.0:1787707186.056327:0:7933:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1787707186.424521:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787707186.514856:0:7988:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg446-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787707187.450049:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707188.473830:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707188.538671:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787707188.538703:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729704576:0@lo:13: 00000100:00100000:2.0:1787707188.538785:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707188.538852:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729704576 00000100:00100000:2.0:1787707188.538873:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729704576 00000100:00100000:2.0:1787707188.538924:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787707188.538933:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729704576:12345-0@lo:13: 00002000:00000024:2.0:1787707188.538970:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707188.539027:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729704576:12345-0@lo:13: Request processed in 94us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707188.539034:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787707188.539074:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa0871df80 x1874546729704576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707188.539096:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729704576:0@lo:13: 00000100:00080000:1.0:1787707188.539157:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787707189.496564:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707190.526222:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707190.598229:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729704960:0@lo:400: 00000100:00100000:1.0:1787707190.598327:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707190.598463:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729704704:0@lo:400: 00000100:00100000:0.0:1787707190.598512:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707190.598575:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729705216:0@lo:400: 00000100:00100000:0.0:1787707190.598623:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729704704 00000100:00100000:0.0:1787707190.598632:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729704704 00000100:00100000:3.0:1787707190.598750:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729704832:0@lo:400: 00000100:00100000:0.0:1787707190.603589:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787707190.603620:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07315050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729704704:12345-0@lo:400: 00000100:00100000:0.0:1787707190.604734:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07315050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729704704:12345-0@lo:400: Request processed in 1123us (6215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707190.604748:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787707190.605568:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729705088:0@lo:400: 00000100:00100000:1.0:1787707190.605637:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707190.605694:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729704960 00000100:00100000:1.0:1787707190.605704:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729704960 00000100:00100000:1.0:1787707190.605769:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787707190.605781:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729704960:12345-0@lo:400: 00000100:00100000:1.0:1787707190.605837:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729704960:12345-0@lo:400: Request processed in 59us (7510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707190.605844:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787707190.605869:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707190.605897:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729705344:0@lo:400: 00000100:00100000:1.0:1787707190.605921:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707190.605974:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729705088 00000100:00100000:1.0:1787707190.605979:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729705088 00000100:00100000:1.0:1787707190.606004:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729705344 00000100:00100000:1.0:1787707190.606007:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729705344 00000100:00100000:1.0:1787707190.606027:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787707190.606034:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729705088:12345-0@lo:400: 00000100:00100000:1.0:1787707190.606073:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729705088:12345-0@lo:400: Request processed in 39us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707190.606080:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787707190.606115:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787707190.606121:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1874546729705344:12345-0@lo:400: 00000100:00100000:1.0:1787707190.606152:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1874546729705344:12345-0@lo:400: Request processed in 32us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707190.606158:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787707190.606173:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787707190.606177:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787707190.606180:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787707190.606188:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729704832 00000100:00100000:1.0:1787707190.606191:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729704832 00000100:00100000:1.0:1787707190.606213:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787707190.606219:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729704832:12345-0@lo:400: 00000100:00100000:1.0:1787707190.606249:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729704832:12345-0@lo:400: Request processed in 30us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707190.606254:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787707190.606293:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3ac50e00 x1874546729705088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707190.606308:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729705088:0@lo:400: 00010000:00080000:1.0:1787707190.606446:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acced80 x1874546729704832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707190.606456:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729704832:0@lo:400: 00010000:00080000:1.0:1787707190.606471:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3ac50700 x1874546729705344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707190.606480:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729705344:0@lo:400: 00010000:00080000:1.0:1787707190.606511:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3ac50380 x1874546729704960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707190.606534:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729704960:0@lo:400: 00000100:00100000:0.0:1787707190.607628:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707190.607696:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729704704:0@lo:400: 00000100:00100000:1.0:1787707190.607949:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729705216 00000100:00100000:1.0:1787707190.607958:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729705216 00000100:00080000:0.0:1787707190.608069:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787707190.608419:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787707190.608432:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729705216:12345-0@lo:400: 00000100:00100000:1.0:1787707190.608524:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729705216:12345-0@lo:400: Request processed in 96us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707190.608532:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787707190.608601:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3ac52a00 x1874546729705216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707190.608615:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729705216:0@lo:400: 00000100:00100000:3.0:1787707191.097117:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787707191.097144:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3f911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729705472:0@lo:13: 00000100:00100000:3.0:1787707191.097219:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707191.097299:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729705472 00000100:00100000:3.0:1787707191.097308:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729705472 00000100:00100000:3.0:1787707191.097475:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787707191.097486:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874546729705472:12345-0@lo:13: 00002000:00000024:3.0:1787707191.097519:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707191.097577:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874546729705472:12345-0@lo:13: Request processed in 93us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707191.097585:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787707191.097782:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3f911c00 x1874546729705472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707191.097803:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3f911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729705472:0@lo:13: 00000001:00080000:1.0:1787707191.211243:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1787707191.546545:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707192.482310:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707192.484750:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707660928 00000100:00100000:1.0:1787707192.484767:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707660928 00000100:00100000:1.0:1787707192.484839:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 113 00000100:00100000:1.0:1787707192.484847:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07315850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1874546707660928:12345-192.168.204.46@tcp:250: 00010000:00080000:1.0:1787707192.484875:0:5851:0:(ldlm_lib.c:1455:target_handle_connect()) MGS: connection from 60f5ae37-220d-45d9-b012-b91715df156e@192.168.204.46@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:1.0:1787707192.484918:0:5851:0:(genops.c:1385:class_connect()) connect: client 60f5ae37-220d-45d9-b012-b91715df156e, cookie 0xc5f18d5f94ec08c0 00000100:00080000:1.0:1787707192.485061:0:5851:0:(import.c:65:import_set_state_nolock()) ffff8cfa05842000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787707192.485141:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07315850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+5:2358:x1874546707660928:12345-192.168.204.46@tcp:250: Request processed in 292us (2839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707192.485149:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 113 00000100:00100000:3.0:1787707192.502492:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707192.503049:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707661056 00000100:00100000:1.0:1787707192.503064:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707661056 00000100:00100000:1.0:1787707192.503118:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 114 00000100:00100000:1.0:1787707192.503129:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+5:5588:x1874546707661056:12345-192.168.204.46@tcp:101: 00010000:00010000:1.0:1787707192.503148:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707192.503167:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa029d4000/0xc5f18d5f94ec08c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9b62 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707192.503209:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa029d4000/0xc5f18d5f94ec08c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b62 expref: 6 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707192.503221:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa029d4000/0xc5f18d5f94ec08c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b62 expref: 6 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707192.503230:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d4000, rc 0) 00000100:00100000:1.0:1787707192.503933:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+6:5588:x1874546707661056:12345-192.168.204.46@tcp:101: Request processed in 801us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707192.503941:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 114 00000100:00100000:2.0:1787707192.517173:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707192.518235:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707661184 00000100:00100000:1.0:1787707192.518258:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707661184 00000100:00100000:3.0:1787707192.518486:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 115 00000100:00100000:3.0:1787707192.518498:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+6:5588:x1874546707661184:12345-192.168.204.46@tcp:501: 00000100:00100000:3.0:1787707192.518865:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+6:5588:x1874546707661184:12345-192.168.204.46@tcp:501: Request processed in 368us (1702us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787707192.518875:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 115 00000100:00100000:2.0:1787707192.533282:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707192.533460:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707661312 00000100:00100000:3.0:1787707192.533470:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707661312 00000100:00100000:3.0:1787707192.533526:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 116 00000100:00100000:3.0:1787707192.533536:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+6:5588:x1874546707661312:12345-192.168.204.46@tcp:101: 00010000:00010000:3.0:1787707192.533566:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707192.533593:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec08ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9b69 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707192.533622:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec08ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b69 expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707192.533632:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec08ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b69 expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707192.533641:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fcc00, rc 0) 00000100:00100000:3.0:1787707192.533693:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+7:5588:x1874546707661312:12345-192.168.204.46@tcp:101: Request processed in 158us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707192.533701:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 116 00000100:00100000:0.0:1787707192.542622:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707192.543893:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707661440 00000100:00100000:1.0:1787707192.543916:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707661440 00000100:00100000:1.0:1787707192.544886:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 117 00000100:00100000:1.0:1787707192.544899:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+7:5588:x1874546707661440:12345-192.168.204.46@tcp:501: 00000100:00100000:1.0:1787707192.545200:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+8:5588:x1874546707661440:12345-192.168.204.46@tcp:501: Request processed in 303us (2589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707192.545209:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 117 00000100:00100000:2.0:1787707192.554478:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707192.554928:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707661568 00000100:00100000:3.0:1787707192.554941:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707661568 00000100:00100000:3.0:1787707192.555001:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 118 00000100:00100000:3.0:1787707192.555012:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+8:5588:x1874546707661568:12345-192.168.204.46@tcp:503: 00000100:00100000:3.0:1787707192.555407:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+8:5588:x1874546707661568:12345-192.168.204.46@tcp:503: Request processed in 395us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707192.555415:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 118 00000100:00100000:1.0:1787707192.560854:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707192.561256:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707661696 00000100:00100000:3.0:1787707192.561276:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707661696 00000100:00100000:3.0:1787707192.561335:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 119 00000100:00100000:3.0:1787707192.561348:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+8:5607:x1874546707661696:12345-192.168.204.46@tcp:502: 00000100:00100000:3.0:1787707192.563984:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+8:5607:x1874546707661696:12345-192.168.204.46@tcp:502: Request processed in 1103us (1606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707192.564023:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 119 00010000:00010000:2.0:1787707192.568866:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707192.617271:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707192.618319:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707661824 00000100:00100000:0.0:1787707192.618334:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707661824 00000100:00100000:0.0:1787707192.618423:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 120 00000100:00100000:0.0:1787707192.618435:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+8:5607:x1874546707661824:12345-192.168.204.46@tcp:502: 00000100:00100000:0.0:1787707192.621054:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+8:5607:x1874546707661824:12345-192.168.204.46@tcp:502: Request processed in 2338us (3519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707192.621069:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 120 00000100:00100000:3.0:1787707192.645131:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707192.645334:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707661952 00000100:00100000:0.0:1787707192.645359:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707661952 00000100:00100000:0.0:1787707192.645435:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 121 00000100:00100000:0.0:1787707192.645447:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+8:5588:x1874546707661952:12345-192.168.204.46@tcp:101: 00010000:00010000:0.0:1787707192.645467:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707192.645484:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa3fcd3600/0xc5f18d5f94ec08d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9b93 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707192.645513:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa3fcd3600/0xc5f18d5f94ec08d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b93 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707192.645525:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa3fcd3600/0xc5f18d5f94ec08d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b93 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707192.645535:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3600, rc 0) 00000100:00100000:0.0:1787707192.645604:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+9:5588:x1874546707661952:12345-192.168.204.46@tcp:101: Request processed in 159us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707192.645611:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 121 00000100:00100000:1.0:1787707192.653679:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707192.653760:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707662080 00000100:00100000:0.0:1787707192.653771:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707662080 00000100:00100000:0.0:1787707192.653827:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 122 00000100:00100000:0.0:1787707192.653836:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+9:5588:x1874546707662080:12345-192.168.204.46@tcp:256: 20000000:01000000:0.0:1787707192.653861:0:5850:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787707192.653883:0:5850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787707192.653887:0:5850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787707192.653890:0:5850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787707192.653892:0:5850:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787707192.659056:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+9:5588:x1874546707662080:12345-192.168.204.46@tcp:256: Request processed in 5208us (5374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707192.659072:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 122 00000100:00100000:1.0:1787707192.673532:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707192.673629:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707662208 00000100:00100000:2.0:1787707192.673639:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707662208 00000100:00100000:2.0:1787707192.673702:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 123 00000100:00100000:2.0:1787707192.673714:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+9:5588:x1874546707662208:12345-192.168.204.46@tcp:101: 00010000:00010000:2.0:1787707192.673733:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707192.673750:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa013fde00/0xc5f18d5f94ec08dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9b9a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707192.673791:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa013fde00/0xc5f18d5f94ec08dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b9a expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707192.673804:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa013fde00/0xc5f18d5f94ec08dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b9a expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707192.673814:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa013fde00, rc 0) 00000100:00100000:2.0:1787707192.673869:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+10:5588:x1874546707662208:12345-192.168.204.46@tcp:101: Request processed in 157us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707192.673877:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 123 00000100:00100000:1.0:1787707192.679495:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707192.679721:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707662336 00000100:00100000:2.0:1787707192.679730:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707662336 00000100:00100000:2.0:1787707192.679792:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 124 00000100:00100000:2.0:1787707192.679816:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+10:5588:x1874546707662336:12345-192.168.204.46@tcp:501: 00000100:00100000:2.0:1787707192.680136:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+10:5588:x1874546707662336:12345-192.168.204.46@tcp:501: Request processed in 322us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707192.680144:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 124 00000100:00100000:3.0:1787707192.695099:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707192.695138:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707662464 00000100:00100000:3.0:1787707192.695147:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707662464 00000100:00100000:3.0:1787707192.695202:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 125 00000100:00100000:3.0:1787707192.695212:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+10:5588:x1874546707662464:12345-192.168.204.46@tcp:503: 00000100:00100000:3.0:1787707192.695656:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+10:5588:x1874546707662464:12345-192.168.204.46@tcp:503: Request processed in 442us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707192.695664:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 125 00000100:00100000:3.0:1787707192.704006:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707192.704219:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707662592 00000100:00100000:2.0:1787707192.704229:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707662592 00000100:00100000:2.0:1787707192.704295:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 126 00000100:00100000:2.0:1787707192.704307:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+10:5609:x1874546707662592:12345-192.168.204.46@tcp:502: 00000100:00100000:2.0:1787707192.704606:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+10:5609:x1874546707662592:12345-192.168.204.46@tcp:502: Request processed in 301us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707192.704615:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 126 00000100:00100000:1.0:1787707192.718085:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707192.718815:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707662720 00000100:00100000:3.0:1787707192.718827:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707662720 00000100:00100000:3.0:1787707192.718895:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 127 00000100:00100000:3.0:1787707192.718919:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+10:5609:x1874546707662720:12345-192.168.204.46@tcp:502: 00000100:00100000:3.0:1787707192.719164:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+10:5609:x1874546707662720:12345-192.168.204.46@tcp:502: Request processed in 247us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707192.719172:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 127 00000100:00100000:0.0:1787707192.723657:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707192.723935:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707662848 00000100:00100000:2.0:1787707192.723945:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707662848 00000100:00100000:2.0:1787707192.723995:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 4 00000100:00100000:2.0:1787707192.724004:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1874546707662848:12345-192.168.204.46@tcp:38: 00010000:00080000:2.0:1787707192.724033:0:5858:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-MDT0000: connection from 9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:2.0:1787707192.724083:0:5858:0:(genops.c:1385:class_connect()) connect: client 9ed4058d-c366-401f-b84d-540fc0489f0c, cookie 0xc5f18d5f94ec08e3 00000004:00100000:2.0:1787707192.724115:0:5858:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787707192.724121:0:5858:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787707192.791166:0:5858:0:(import.c:65:import_set_state_nolock()) ffff8cfa419d4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787707192.791338:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2358:x1874546707662848:12345-192.168.204.46@tcp:38: Request processed in 67331us (67688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707192.791358:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 4 00010000:00010000:2.0:1787707193.592821:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707193.656728:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729705600:0@lo:13: 00000100:00100000:0.0:1787707193.656822:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707193.657046:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729705600 00000100:00100000:3.0:1787707193.657058:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729705600 00000100:00100000:3.0:1787707193.657132:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787707193.657145:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729705600:12345-0@lo:13: 00002000:00000024:3.0:1787707193.657184:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707193.657239:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729705600:12345-0@lo:13: Request processed in 98us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707193.657262:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787707193.657318:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa0871df80 x1874546729705600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707193.657340:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729705600:0@lo:13: 00000100:00080000:0.0:1787707193.657667:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787707193.797562:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707193.797791:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707662976 00000100:00100000:3.0:1787707193.797801:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707662976 00000100:00100000:3.0:1787707193.797896:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 5 00000100:00100000:3.0:1787707193.797910:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:0:x1874546707662976:12345-192.168.204.46@tcp:41: 00000004:00000024:3.0:1787707193.797955:0:5856:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:0.0:1787707193.798188:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707193.798254:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:0:x1874546707662976:12345-192.168.204.46@tcp:41: Request processed in 347us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707193.798262:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 5 00000100:00100000:0.0:1787707193.800553:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707193.800649:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707663104 00000100:00100000:2.0:1787707193.800659:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707663104 00000100:00100000:2.0:1787707193.800721:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 6 00000100:00100000:2.0:1787707193.800732:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:5588:x1874546707663104:12345-192.168.204.46@tcp:41: 00000004:00000024:2.0:1787707193.800771:0:5858:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787707193.800852:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:5588:x1874546707663104:12345-192.168.204.46@tcp:41: Request processed in 121us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707193.800860:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 6 00000100:00100000:0.0:1787707193.803134:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707193.803232:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707663232 00000100:00100000:3.0:1787707193.803243:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707663232 00000100:00100000:3.0:1787707193.803310:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 7 00000100:00100000:3.0:1787707193.803321:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:5588:x1874546707663232:12345-192.168.204.46@tcp:40: 00000100:00100000:3.0:1787707193.803440:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:5588:x1874546707663232:12345-192.168.204.46@tcp:40: Request processed in 120us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707193.803449:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 7 00000100:00100000:1.0:1787707193.809254:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707193.809323:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707193.809384:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707193.809432:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707193.809540:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707663616 00000100:00100000:3.0:1787707193.809550:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707663616 00000100:00100000:3.0:1787707193.809609:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 0 00000100:00100000:3.0:1787707193.809620:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:5588:x1874546707663616:12345-192.168.204.46@tcp:33: 00000100:00100000:2.0:1787707193.811445:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707663360 00000100:00100000:2.0:1787707193.811459:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707663360 00000100:00100000:2.0:1787707193.811494:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707663488 00000100:00100000:2.0:1787707193.811498:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707663488 00000100:00100000:2.0:1787707193.811514:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 8 00000100:00100000:2.0:1787707193.811522:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1874546707663360:12345-192.168.204.46@tcp:8: 00010000:00080000:2.0:1787707193.811551:0:6690:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-OST0000: connection from 9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:2.0:1787707193.811589:0:6690:0:(genops.c:1385:class_connect()) connect: client 9ed4058d-c366-401f-b84d-540fc0489f0c, cookie 0xc5f18d5f94ec08ea 00002000:00100000:2.0:1787707193.811602:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9ed4058d-c366-401f-b84d-540fc0489f0c/ffff8cf9012d0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787707193.811613:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787707193.812078:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787707193.812113:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8cf9012d5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787707193.812187:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2358:x1874546707663360:12345-192.168.204.46@tcp:8: Request processed in 663us (2863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707193.812196:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 8 00000100:00100000:2.0:1787707193.812218:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 9 00000100:00100000:2.0:1787707193.812223:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1874546707663488:12345-192.168.204.46@tcp:8: 00010000:00080000:2.0:1787707193.812240:0:6690:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-OST0001: connection from 9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:2.0:1787707193.812261:0:6690:0:(genops.c:1385:class_connect()) connect: client 9ed4058d-c366-401f-b84d-540fc0489f0c, cookie 0xc5f18d5f94ec08f1 00002000:00100000:2.0:1787707193.812267:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9ed4058d-c366-401f-b84d-540fc0489f0c/ffff8cf9012d3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787707193.812283:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787707193.812983:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707663744 00000100:00100000:0.0:1787707193.812992:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707663744 00000100:00100000:0.0:1787707193.813047:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 128 00000100:00100000:0.0:1787707193.813055:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa18a93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+10:2361:x1874546707663744:12345-192.168.204.46@tcp:400: 00000100:00100000:0.0:1787707193.813094:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa18a93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+10:2361:x1874546707663744:12345-192.168.204.46@tcp:400: Request processed in 40us (3726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707193.813101:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 128 00002000:00080000:2.0:1787707193.813867:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787707193.813927:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8cf9012d3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787707193.813968:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2358:x1874546707663488:12345-192.168.204.46@tcp:8: Request processed in 1743us (4536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707193.813976:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 9 00000004:00080000:3.0:1787707193.833909:0:5859:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 24223us 00000004:00200000:1.0:1787707193.860007:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787707193.860198:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:5588:x1874546707663616:12345-192.168.204.46@tcp:33: Request processed in 50571us (50948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707193.860227:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 0 00000100:00100000:0.0:1787707194.205061:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707194.205143:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707663872 00000100:00100000:3.0:1787707194.205168:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707663872 00000100:00100000:3.0:1787707194.205299:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 8 00000100:00100000:3.0:1787707194.205312:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+6:5626:x1874546707663872:12345-192.168.204.46@tcp:101: 00010000:00010000:3.0:1787707194.205334:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707194.205362:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030e00/0xc5f18d5f94ec08f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9bc4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707194.205467:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec08ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707194.205481:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec08ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707194.205495:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec08ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707194.206505:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787707194.206513:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787707194.206979:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec08ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707194.207020:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030e00/0xc5f18d5f94ec08f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9bc4 expref: 8 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707194.207040:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec08ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9bc4 expref: 7 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707194.207048:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa143e4d00) 00010000:00010000:3.0:1787707194.207051:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787707194.207054:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa00030600, rc 0) 00000100:00100000:3.0:1787707194.207149:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+7:5626:x1874546707663872:12345-192.168.204.46@tcp:101: Request processed in 1838us (2097us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707194.207158:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 8 00010000:00010000:3.0:1787707194.616620:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707195.640549:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707195.705052:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729706112:0@lo:400: 00000100:00100000:3.0:1787707195.705141:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707195.705211:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787707195.705218:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729705984:0@lo:400: 00000100:00100000:3.0:1787707195.705246:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707195.705293:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729706112 00000100:00100000:3.0:1787707195.705300:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729706112 00000100:00100000:3.0:1787707195.705403:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787707195.705414:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729706112:12345-0@lo:400: 00000100:00100000:3.0:1787707195.705464:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729706112:12345-0@lo:400: Request processed in 53us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707195.705471:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787707195.705491:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787707195.705527:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acb7480 x1874546729706112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707195.705541:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729706112:0@lo:400: 00000100:00100000:3.0:1787707195.705565:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729705984 00000100:00100000:3.0:1787707195.705569:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729705984 00000100:00100000:3.0:1787707195.705601:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787707195.705609:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729705984:12345-0@lo:400: 00000100:00100000:3.0:1787707195.705644:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729705984:12345-0@lo:400: Request processed in 36us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707195.705650:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787707195.705680:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707195.705702:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729705984:0@lo:400: 00000100:00100000:0.0:1787707195.706074:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729705728:0@lo:400: 00000100:00100000:0.0:1787707195.706113:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707195.706153:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729706240:0@lo:400: 00000100:00100000:0.0:1787707195.706177:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707195.706200:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787707195.706207:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729705856:0@lo:400: 00000100:00100000:0.0:1787707195.706228:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707195.706242:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729706368:0@lo:400: 00000100:00100000:0.0:1787707195.706262:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707195.706324:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729705728 00000100:00100000:2.0:1787707195.706343:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729705728 00000100:00100000:2.0:1787707195.706403:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787707195.706412:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa18a93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729705728:12345-0@lo:400: 00000100:00100000:2.0:1787707195.706455:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa18a93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729705728:12345-0@lo:400: Request processed in 45us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707195.706461:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787707195.706496:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729705728:0@lo:400: 00000100:00100000:2.0:1787707195.706515:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729706368 00000100:00100000:2.0:1787707195.706518:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729706368 00000100:00100000:2.0:1787707195.706544:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787707195.706551:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729706368:12345-0@lo:400: 00000100:00100000:2.0:1787707195.706585:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729706368:12345-0@lo:400: Request processed in 35us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707195.706591:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787707195.706614:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acb4700 x1874546729706368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707195.706623:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787707195.706632:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729706368:0@lo:400: 00000100:00080000:3.0:1787707195.707471:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787707195.707496:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729706240 00000100:00100000:3.0:1787707195.707502:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729706240 00000100:00100000:3.0:1787707195.707551:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729705856 00000100:00100000:3.0:1787707195.707554:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729705856 00000100:00100000:3.0:1787707195.707571:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787707195.707579:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729706240:12345-0@lo:400: 00000100:00100000:3.0:1787707195.707641:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729706240:12345-0@lo:400: Request processed in 63us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707195.707648:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787707195.707663:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787707195.707670:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729705856:12345-0@lo:400: 00000100:00100000:3.0:1787707195.707697:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729705856:12345-0@lo:400: Request processed in 27us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707195.707702:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787707195.708460:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787707195.708564:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729705856:0@lo:400: 00000100:00100000:2.0:1787707195.708580:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729706240:0@lo:400: 00000100:00100000:2.0:1787707196.216848:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3f910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729706496:0@lo:13: 00000100:00100000:2.0:1787707196.216926:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707196.217171:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729706496 00000100:00100000:0.0:1787707196.217181:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729706496 00000100:00100000:0.0:1787707196.217237:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787707196.217246:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729706496:12345-0@lo:13: 00002000:00000024:0.0:1787707196.217282:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707196.217333:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729706496:12345-0@lo:13: Request processed in 87us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707196.217340:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787707196.217440:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3f910000 x1874546729706496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707196.217460:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3f910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729706496:0@lo:13: 00000100:00100000:1.0:1787707196.594466:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707196.594594:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707664000 00000100:00100000:3.0:1787707196.594606:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707664000 00000100:00100000:3.0:1787707196.594694:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 9 00000100:00100000:3.0:1787707196.594706:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+7:5678:x1874546707664000:12345-192.168.204.46@tcp:41: 00000004:00000024:3.0:1787707196.594754:0:5858:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787707196.594839:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+7:5678:x1874546707664000:12345-192.168.204.46@tcp:41: Request processed in 135us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707196.594846:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 9 00000100:00080000:0.0:1787707196.595042:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707196.604038:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707196.604315:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707664128 00000100:00100000:3.0:1787707196.604326:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707664128 00000100:00100000:3.0:1787707196.604452:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 10 00000100:00100000:3.0:1787707196.604464:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9ed4058d-c366-401f-b84d-540fc0489f0c+6:5678:x1874546707664128:12345-192.168.204.46@tcp:13: 00002000:00000024:3.0:1787707196.604504:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707196.604580:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9ed4058d-c366-401f-b84d-540fc0489f0c+6:5678:x1874546707664128:12345-192.168.204.46@tcp:13: Request processed in 120us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707196.604587:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 10 00000100:00080000:0.0:1787707196.608334:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787707196.614536:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707196.614889:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707664256 00000100:00100000:3.0:1787707196.614899:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707664256 00000100:00100000:3.0:1787707196.614982:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 11 00000100:00100000:3.0:1787707196.614994:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9ed4058d-c366-401f-b84d-540fc0489f0c+6:5678:x1874546707664256:12345-192.168.204.46@tcp:13: 00002000:00000024:3.0:1787707196.615019:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707196.615294:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9ed4058d-c366-401f-b84d-540fc0489f0c+6:5678:x1874546707664256:12345-192.168.204.46@tcp:13: Request processed in 302us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707196.615303:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 11 00000100:00080000:0.0:1787707196.615729:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787707196.664548:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787707197.331587:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9ed4058d-c366-401f-b84d-540fc0489f0c 00010000:00010000:0.0:1787707197.689940:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787707197.812472:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9ed4058d-c366-401f-b84d-540fc0489f0c 00000001:00100000:3.0:1787707198.317156:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9ed4058d-c366-401f-b84d-540fc0489f0c 00010000:00010000:2.0:1787707198.714508:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707198.783283:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729706624:0@lo:13: 00000100:00100000:1.0:1787707198.783358:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707198.785053:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729706624 00000100:00100000:1.0:1787707198.785066:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729706624 00000100:00080000:3.0:1787707198.785131:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787707198.785141:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787707198.785152:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729706624:12345-0@lo:13: 00002000:00000024:1.0:1787707198.785187:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787707198.785257:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729706624:12345-0@lo:13: Request processed in 107us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707198.785265:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787707198.785411:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3ac53800 x1874546729706624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707198.785432:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729706624:0@lo:13: 00000100:00100000:1.0:1787707198.850494:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707198.850547:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707198.850584:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707198.850617:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707198.850619:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707664384 00000100:00100000:0.0:1787707198.850630:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707664384 00000100:00100000:1.0:1787707198.850650:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707664768 00000100:00100000:1.0:1787707198.850674:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707664768 00000100:00100000:0.0:1787707198.850690:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 130 00000100:00100000:0.0:1787707198.850703:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa18a91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+10:2360:x1874546707664384:12345-192.168.204.46@tcp:400: 00000100:00100000:1.0:1787707198.850725:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707664640 00000100:00100000:1.0:1787707198.850730:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707664640 00000100:00100000:1.0:1787707198.850749:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 8 00000100:00100000:1.0:1787707198.850757:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2360:x1874546707664768:12345-192.168.204.46@tcp:400: 00000100:00100000:3.0:1787707198.850849:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707664512 00000100:00100000:3.0:1787707198.850853:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707664512 00000100:00100000:3.0:1787707198.850888:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 25 00000100:00100000:3.0:1787707198.850896:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2360:x1874546707664512:12345-192.168.204.46@tcp:400: 00000100:00100000:2.0:1787707198.850993:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787707198.851004:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787707198.851130:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa18a91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+10:2360:x1874546707664384:12345-192.168.204.46@tcp:400: Request processed in 113us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707198.851139:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 130 00000100:00100000:1.0:1787707198.852295:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2360:x1874546707664768:12345-192.168.204.46@tcp:400: Request processed in 1529us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707198.852309:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 8 00000100:00100000:1.0:1787707198.852339:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 9 00000100:00100000:1.0:1787707198.852351:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2360:x1874546707664640:12345-192.168.204.46@tcp:400: 00000100:00100000:1.0:1787707198.852421:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2360:x1874546707664640:12345-192.168.204.46@tcp:400: Request processed in 75us (1803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707198.852427:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 9 00000100:00080000:1.0:1787707198.852451:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787707198.852456:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787707198.852459:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787707198.860676:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2360:x1874546707664512:12345-192.168.204.46@tcp:400: Request processed in 6212us (6628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707198.860725:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 25 00000001:02000400:0.0:1787707199.438248:0:8295:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787707199.736723:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707200.765924:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707200.827162:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3f910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729706880:0@lo:400: 00000100:00100000:1.0:1787707200.827273:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707200.827352:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729707392:0@lo:400: 00000100:00100000:1.0:1787707200.827406:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707200.827443:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787707200.827450:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3f910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729706752:0@lo:400: 00000100:00100000:1.0:1787707200.827483:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707200.827506:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729707264:0@lo:400: 00000100:00100000:1.0:1787707200.827529:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707200.827558:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729707008:0@lo:400: 00000100:00100000:1.0:1787707200.827595:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707200.827617:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787707200.827623:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729707136:0@lo:400: 00000100:00100000:1.0:1787707200.827645:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707200.827675:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729707392 00000100:00100000:1.0:1787707200.827684:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729707392 00000100:00100000:1.0:1787707200.827769:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729707136 00000100:00100000:1.0:1787707200.827773:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729707136 00000100:00100000:1.0:1787707200.827808:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787707200.827819:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729707392:12345-0@lo:400: 00000100:00100000:1.0:1787707200.827885:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729707392:12345-0@lo:400: Request processed in 68us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707200.827894:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787707200.827913:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787707200.827920:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729707136:12345-0@lo:400: 00000100:00100000:1.0:1787707200.827956:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729707136:12345-0@lo:400: Request processed in 36us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707200.827962:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787707200.827982:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729706752 00000100:00100000:1.0:1787707200.827986:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729706752 00000100:00100000:1.0:1787707200.828012:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787707200.828018:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729706752:12345-0@lo:400: 00000100:00100000:1.0:1787707200.828049:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729706752:12345-0@lo:400: Request processed in 32us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707200.828055:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787707200.828088:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729706880 00000100:00100000:1.0:1787707200.828092:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729706880 00000100:00100000:1.0:1787707200.828121:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729707264 00000100:00100000:1.0:1787707200.828125:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729707264 00000100:00100000:1.0:1787707200.828139:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729707008 00000100:00100000:1.0:1787707200.828141:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729707008 00000100:00100000:1.0:1787707200.828162:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787707200.828168:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729706880:12345-0@lo:400: 00000100:00100000:1.0:1787707200.828202:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729706880:12345-0@lo:400: Request processed in 34us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707200.828208:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787707200.828221:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787707200.828226:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729707264:12345-0@lo:400: 00000100:00100000:1.0:1787707200.828249:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729707264:12345-0@lo:400: Request processed in 23us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707200.828254:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787707200.828264:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787707200.828269:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729707008:12345-0@lo:400: 00000100:00100000:1.0:1787707200.828292:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729707008:12345-0@lo:400: Request processed in 23us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707200.828297:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787707200.828328:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787707200.828334:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787707200.828335:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787707200.828394:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa35b00a80 x1874546729707136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707200.828413:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729707136:0@lo:400: 00000100:00100000:1.0:1787707200.828426:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729707008:0@lo:400: 00000100:00100000:1.0:1787707200.828461:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3f910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729706752:0@lo:400: 00000100:00100000:1.0:1787707200.828482:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729707264:0@lo:400: 00000100:00100000:1.0:1787707200.828493:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3f910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729706880:0@lo:400: 00010000:00080000:1.0:1787707200.828503:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa35b03b80 x1874546729707392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707200.828512:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729707392:0@lo:400: 00000100:00100000:2.0:1787707201.339895:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729707520:0@lo:13: 00000100:00100000:2.0:1787707201.340005:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707201.347673:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729707520 00000100:00100000:1.0:1787707201.347695:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729707520 00000100:00100000:1.0:1787707201.347790:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787707201.347804:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729707520:12345-0@lo:13: 00002000:00000024:1.0:1787707201.347858:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787707201.347981:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729707520:12345-0@lo:13: Request processed in 179us (7974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707201.347989:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787707201.359844:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa35b01180 x1874546729707520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707201.359898:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729707520:0@lo:13: 00010000:00010000:1.0:1787707201.784525:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707202.809428:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787707203.478151:0:8445:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb6faf350 20000000:00000080:0.0:1787707203.478170:0:8445:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cf901f2d400 uarg=0000000000000000 20000000:01000000:0.0:1787707203.478209:0:8445:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787707203.478211:0:8445:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787707203.478214:0:8445:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787707203.478218:0:8445:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787707203.478223:0:8445:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787707203.478324:0:8445:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787707203.478326:0:8445:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787707203.478588:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787707203.478592:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787707203.488034:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1787707203.489035:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1787707203.489122:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1787707203.489179:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1787707203.489195:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787707203.489197:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787707203.490622:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1787707203.491162:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1787707203.491217:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1787707203.491257:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1787707203.491270:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787707203.491272:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787707203.492243:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1787707203.492705:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1787707203.492756:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1787707203.492809:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1787707203.492822:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787707203.492824:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787707203.493686:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787707203.494039:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787707203.494100:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1787707203.494280:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:1.0:1787707203.494297:0:8445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787707203.494317:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0906 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.494336:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa029d5a00/0xc5f18d5f94ec0803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec07fc expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.494352:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa013fc000/0xc5f18d5f94ec082d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0826 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.494359:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa029d4600/0xc5f18d5f94ec0857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0850 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.494365:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa013fdc00/0xc5f18d5f94ec0865 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec085e expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.494404:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec0873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec086c expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.494411:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa029d4e00/0xc5f18d5f94ec088f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0888 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.494417:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa421fdc00/0xc5f18d5f94ec08b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec08b2 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.494427:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa029d4000/0xc5f18d5f94ec08c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b62 expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.494434:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec08ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b69 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.494441:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0906 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.494484:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec08ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b69 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.494510:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec08ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b69 expref: 9 pid: 5848 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707203.494526:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3f910700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874546729707648:192.168.204.46@tcp:104: 00010000:00010000:1.0:1787707203.494630:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa029d4000/0xc5f18d5f94ec08c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b62 expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.494637:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfa029d4000/0xc5f18d5f94ec08c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b62 expref: 9 pid: 5850 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707203.494645:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3f910000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874546729707776:192.168.204.46@tcp:104: 00010000:00010000:1.0:1787707203.494671:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa421fdc00/0xc5f18d5f94ec08b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec08b2 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.494679:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa421fdc00/0xc5f18d5f94ec08b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec08b2 expref: 18 pid: 5848 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707203.494687:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874546729707904:0@lo:104: 00000100:00100000:1.0:1787707203.494738:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787707203.494795:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa029d4e00/0xc5f18d5f94ec088f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec0888 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.494803:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa029d4e00/0xc5f18d5f94ec088f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0888 expref: 18 pid: 5850 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707203.494812:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ecf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874546729708032:0@lo:104: 00000100:00100000:1.0:1787707203.494838:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787707203.494867:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec0873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec086c expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.494875:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec0873 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec086c expref: 18 pid: 5850 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707203.494884:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ece300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874546729708160:0@lo:104: 00010000:00010000:1.0:1787707203.494907:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa013fdc00/0xc5f18d5f94ec0865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec085e expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.494915:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa013fdc00/0xc5f18d5f94ec0865 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec085e expref: 18 pid: 5848 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707203.494923:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06eced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874546729708288:0@lo:104: 00010000:00010000:1.0:1787707203.494946:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa029d4600/0xc5f18d5f94ec0857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec0850 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.494954:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa029d4600/0xc5f18d5f94ec0857 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0850 expref: 18 pid: 5850 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707203.494962:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ecf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874546729708416:0@lo:104: 00010000:00010000:1.0:1787707203.494984:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa013fc000/0xc5f18d5f94ec082d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec0826 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.494992:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa013fc000/0xc5f18d5f94ec082d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0826 expref: 18 pid: 5848 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707203.494999:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ecca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874546729708544:0@lo:104: 00010000:00010000:1.0:1787707203.495021:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa029d5a00/0xc5f18d5f94ec0803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec07fc expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707203.495038:0:5840:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1787707203.495042:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa029d5a00/0xc5f18d5f94ec0803 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec07fc expref: 18 pid: 5848 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707203.495053:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ecc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874546729708672:0@lo:104: 00000100:00100000:3.0:1787707203.495074:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707203.499423:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729707904 00000100:00100000:2.0:1787707203.499440:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729707904 00000100:00100000:2.0:1787707203.499485:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729708032 00000100:00100000:2.0:1787707203.499489:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729708032 00000100:00100000:2.0:1787707203.499500:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729708160 00000100:00100000:2.0:1787707203.499504:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729708160 00000100:00100000:2.0:1787707203.499520:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787707203.499530:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+5:8445:x1874546729707904:12345-0@lo:104: 00010000:00010000:2.0:1787707203.499550:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4200/0xc5f18d5f94ec08b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec08b9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.503344:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787707203.503360:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+5:8445:x1874546729707904:12345-0@lo:104: Request processed in 3828us (8618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707203.503402:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787707203.503437:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787707203.503447:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa4199ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+4:8445:x1874546729708032:12345-0@lo:104: 00010000:00010000:2.0:1787707203.503465:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd600/0xc5f18d5f94ec0888 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec088f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.503515:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787707203.503520:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa4199ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+4:8445:x1874546729708032:12345-0@lo:104: Request processed in 77us (8682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707203.503526:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787707203.503557:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787707203.503564:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:8445:x1874546729708160:12345-0@lo:104: 00010000:00010000:2.0:1787707203.503572:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5000/0xc5f18d5f94ec086c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0873 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.503606:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787707203.503611:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:8445:x1874546729708160:12345-0@lo:104: Request processed in 48us (8539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707203.503617:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1787707203.503637:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787707203.503643:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4200/0xc5f18d5f94ec08b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec08b9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.503651:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4200 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:2.0:1787707203.503655:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4200/0xc5f18d5f94ec08b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec08b9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.503677:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4200/0xc5f18d5f94ec08b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec08b9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787707203.503684:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4200/0xc5f18d5f94ec08b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec08b9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707203.503690:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787707203.503735:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4200/0xc5f18d5f94ec08b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec08b9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.503742:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787707203.503761:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4200/0xc5f18d5f94ec08b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec08b9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.503768:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4200/0xc5f18d5f94ec08b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec08b9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.503781:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787707203.503784:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd600/0xc5f18d5f94ec0888 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec088f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.503790:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd600 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:2.0:1787707203.503792:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd600/0xc5f18d5f94ec0888 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec088f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.503799:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd600/0xc5f18d5f94ec0888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec088f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787707203.503806:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd600/0xc5f18d5f94ec0888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec088f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707203.503817:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787707203.503832:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd600/0xc5f18d5f94ec0888 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec088f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.503838:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787707203.503852:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd600/0xc5f18d5f94ec0888 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec088f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.503859:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd600/0xc5f18d5f94ec0888 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec088f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.503868:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787707203.503871:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5000/0xc5f18d5f94ec086c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0873 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.503877:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d5000 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:2.0:1787707203.503879:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5000/0xc5f18d5f94ec086c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec0873 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.503885:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5000/0xc5f18d5f94ec086c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec0873 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787707203.503891:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5000/0xc5f18d5f94ec086c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec0873 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707203.503897:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787707203.503909:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5000/0xc5f18d5f94ec086c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0873 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.503914:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787707203.503926:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5000/0xc5f18d5f94ec086c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0873 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.503932:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5000/0xc5f18d5f94ec086c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0873 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.503942:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707203.503944:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707203.503946:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707203.503953:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707203.503975:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729708800:0@lo:103: 00000100:00100000:2.0:1787707203.504031:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707203.504095:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729708928:0@lo:103: 00000100:00100000:2.0:1787707203.504120:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707203.504138:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787707203.504144:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729709056:0@lo:103: 00000100:00100000:2.0:1787707203.504178:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707203.504210:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729708800 00000100:00100000:2.0:1787707203.504217:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729708800 00010000:00010000:2.0:1787707203.504244:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa421fdc00/0xc5f18d5f94ec08b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec08b2 expref: 19 pid: 5848 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707203.504262:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729708928 00000100:00100000:2.0:1787707203.504265:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729708928 00010000:00010000:2.0:1787707203.504278:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa029d4e00/0xc5f18d5f94ec088f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0888 expref: 20 pid: 5850 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707203.504289:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729709056 00000100:00100000:2.0:1787707203.504291:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729709056 00010000:00010000:2.0:1787707203.504300:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec0873 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec086c expref: 21 pid: 5850 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707203.504321:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787707203.504327:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+21:3317:x1874546729708800:12345-0@lo:103: 00010000:00010000:2.0:1787707203.504338:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707203.504343:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa421fdc00/0xc5f18d5f94ec08b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec08b2 expref: 21 pid: 5848 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.504353:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa421fdc00/0xc5f18d5f94ec08b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec08b2 expref: 21 pid: 5848 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.504396:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707203.504425:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+21:3317:x1874546729708800:12345-0@lo:103: Request processed in 99us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707203.504432:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787707203.504446:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787707203.504452:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+20:3314:x1874546729708928:12345-0@lo:103: 00010000:00010000:2.0:1787707203.504459:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707203.504464:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa029d4e00/0xc5f18d5f94ec088f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0888 expref: 20 pid: 5850 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.504472:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa029d4e00/0xc5f18d5f94ec088f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0888 expref: 20 pid: 5850 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.504481:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707203.504506:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+20:3314:x1874546729708928:12345-0@lo:103: Request processed in 55us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707203.504512:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787707203.504524:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787707203.504538:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729709056:12345-0@lo:103: 00010000:00010000:2.0:1787707203.504546:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707203.504550:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec0873 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec086c expref: 19 pid: 5850 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.504559:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec0873 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec086c expref: 19 pid: 5850 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707203.504569:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707203.504592:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729709056:12345-0@lo:103: Request processed in 56us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707203.504598:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787707203.504635:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729708800:0@lo:103: 00000100:00100000:2.0:1787707203.504660:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729709056:0@lo:103: 00000100:00100000:2.0:1787707203.504668:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729708928:0@lo:103: 00010000:00010000:0.0:1787707203.506795:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707203.506967:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707203.507004:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707203.507016:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707203.507028:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729708288 00000100:00100000:3.0:1787707203.507036:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729708288 00000100:00100000:3.0:1787707203.507091:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729708416 00000100:00100000:3.0:1787707203.507094:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729708416 00000100:00100000:3.0:1787707203.507108:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729708544 00000100:00100000:3.0:1787707203.507110:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729708544 00000100:00100000:3.0:1787707203.507122:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787707203.507131:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+5:8445:x1874546729708288:12345-0@lo:104: 00010000:00010000:3.0:1787707203.507147:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec085e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0865 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.507230:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787707203.507236:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+5:8445:x1874546729708288:12345-0@lo:104: Request processed in 107us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707203.507243:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787707203.507260:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787707203.507266:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+4:8445:x1874546729708416:12345-0@lo:104: 00010000:00010000:3.0:1787707203.507273:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc600/0xc5f18d5f94ec0850 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0857 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.507308:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787707203.507313:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+4:8445:x1874546729708416:12345-0@lo:104: Request processed in 49us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707203.507333:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787707203.507346:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787707203.507352:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:8445:x1874546729708544:12345-0@lo:104: 00010000:00010000:3.0:1787707203.507359:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa421fca00/0xc5f18d5f94ec0826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec082d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.507420:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787707203.507426:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:8445:x1874546729708544:12345-0@lo:104: Request processed in 75us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707203.507431:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1787707203.507446:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787707203.507451:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec085e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0865 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.507458:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd400 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:3.0:1787707203.507461:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec085e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec0865 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.507469:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec085e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec0865 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787707203.507476:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec085e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec0865 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787707203.507481:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787707203.507512:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec085e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0865 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.507518:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787707203.507541:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec085e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0865 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.507548:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec085e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0865 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.507563:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787707203.507565:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc600/0xc5f18d5f94ec0850 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0857 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.507571:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa013fc600 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:3.0:1787707203.507573:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc600/0xc5f18d5f94ec0850 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec0857 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.507580:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc600/0xc5f18d5f94ec0850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec0857 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787707203.507585:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc600/0xc5f18d5f94ec0850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec0857 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787707203.507589:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787707203.507603:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc600/0xc5f18d5f94ec0850 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0857 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.507609:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787707203.507614:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc600/0xc5f18d5f94ec0850 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0857 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.507620:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa013fc600/0xc5f18d5f94ec0850 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0857 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.507629:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707203.507638:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa421fca00/0xc5f18d5f94ec0826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec082d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.507644:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fca00 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:3.0:1787707203.507646:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fca00/0xc5f18d5f94ec0826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec082d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.507652:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa421fca00/0xc5f18d5f94ec0826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec082d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787707203.507658:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fca00/0xc5f18d5f94ec0826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec082d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787707203.507663:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787707203.507676:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa421fca00/0xc5f18d5f94ec0826 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec082d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.507681:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787707203.507729:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fca00/0xc5f18d5f94ec0826 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec082d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.507737:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa421fca00/0xc5f18d5f94ec0826 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec082d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.507748:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707203.507750:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707203.507752:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707203.507758:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707203.507771:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729709184:0@lo:103: 00000100:00100000:3.0:1787707203.507806:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707203.507839:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787707203.507854:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729709312:0@lo:103: 00000100:00100000:3.0:1787707203.507879:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707203.507906:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729709440:0@lo:103: 00000100:00100000:3.0:1787707203.507925:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707203.507951:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729709184 00000100:00100000:3.0:1787707203.507955:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729709184 00010000:00010000:3.0:1787707203.507975:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa013fdc00/0xc5f18d5f94ec0865 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec085e expref: 19 pid: 5848 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707203.507989:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729709312 00000100:00100000:3.0:1787707203.507991:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729709312 00010000:00010000:3.0:1787707203.507999:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa029d4600/0xc5f18d5f94ec0857 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0850 expref: 20 pid: 5850 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707203.508007:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729709440 00000100:00100000:3.0:1787707203.508010:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729709440 00010000:00010000:3.0:1787707203.508018:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa013fc000/0xc5f18d5f94ec082d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0826 expref: 21 pid: 5848 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707203.508029:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787707203.508035:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+21:3316:x1874546729709184:12345-0@lo:103: 00010000:00010000:3.0:1787707203.508044:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707203.508049:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa013fdc00/0xc5f18d5f94ec0865 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec085e expref: 21 pid: 5848 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.508064:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa013fdc00/0xc5f18d5f94ec0865 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec085e expref: 21 pid: 5848 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.508081:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707203.508109:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+21:3316:x1874546729709184:12345-0@lo:103: Request processed in 74us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707203.508121:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787707203.508135:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787707203.508141:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+20:3316:x1874546729709312:12345-0@lo:103: 00010000:00010000:3.0:1787707203.508148:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707203.508153:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa029d4600/0xc5f18d5f94ec0857 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0850 expref: 20 pid: 5850 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.508160:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa029d4600/0xc5f18d5f94ec0857 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0850 expref: 20 pid: 5850 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.508170:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707203.508193:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+20:3316:x1874546729709312:12345-0@lo:103: Request processed in 53us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707203.508199:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787707203.508210:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787707203.508216:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729709440:12345-0@lo:103: 00010000:00010000:3.0:1787707203.508223:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707203.508227:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa013fc000/0xc5f18d5f94ec082d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0826 expref: 19 pid: 5848 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.508235:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa013fc000/0xc5f18d5f94ec082d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0826 expref: 19 pid: 5848 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.508244:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707203.508268:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729709440:12345-0@lo:103: Request processed in 52us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707203.508273:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787707203.508308:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729709312:0@lo:103: 00000100:00100000:3.0:1787707203.508322:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729709184:0@lo:103: 00000100:00100000:3.0:1787707203.508346:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729709440:0@lo:103: 00010000:00010000:0.0:1787707203.508719:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707203.509652:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707203.509738:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1fad83c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787707203.509763:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa421fdc00/0xc5f18d5f94ec08b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec08b2 expref: 18 pid: 5848 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707203.509776:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874546729707904:0@lo:104: 00010000:00010000:1.0:1787707203.509788:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa029d4e00/0xc5f18d5f94ec088f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec0888 expref: 17 pid: 5850 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707203.509796:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ecf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874546729708032:0@lo:104: 00010000:00010000:1.0:1787707203.509805:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec0873 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec086c expref: 16 pid: 5850 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707203.509813:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ece300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874546729708160:0@lo:104: 00010000:00010000:1.0:1787707203.509821:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa013fdc00/0xc5f18d5f94ec0865 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec085e expref: 15 pid: 5848 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707203.509830:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06eced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874546729708288:0@lo:104: 00010000:00010000:1.0:1787707203.509837:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa029d4600/0xc5f18d5f94ec0857 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec0850 expref: 14 pid: 5850 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707203.509845:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ecf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874546729708416:0@lo:104: 00010000:00010000:1.0:1787707203.509853:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa013fc000/0xc5f18d5f94ec082d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec0826 expref: 13 pid: 5848 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707203.509873:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ecca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874546729708544:0@lo:104: 00000100:00100000:3.0:1787707203.509911:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729708672 00000100:00100000:3.0:1787707203.509976:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729708672 00000100:00100000:3.0:1787707203.510167:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787707203.510176:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:8445:x1874546729708672:12345-0@lo:104: 00010000:00010000:3.0:1787707203.510189:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3200/0xc5f18d5f94ec07fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0803 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.510268:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787707203.510274:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:8445:x1874546729708672:12345-0@lo:104: Request processed in 100us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707203.510281:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787707203.510325:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787707203.510333:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3200/0xc5f18d5f94ec07fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0803 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707203.510340:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3200 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:0.0:1787707203.510345:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3200/0xc5f18d5f94ec07fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec0803 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707203.510352:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3200/0xc5f18d5f94ec07fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec0803 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787707203.510359:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3200/0xc5f18d5f94ec07fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec0803 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707203.510364:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787707203.510435:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3200/0xc5f18d5f94ec07fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0803 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707203.510442:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787707203.510459:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3200/0xc5f18d5f94ec07fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0803 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707203.510465:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3200/0xc5f18d5f94ec07fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0803 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707203.510480:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707203.510481:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707203.510483:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707203.510552:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ecc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874546729708672:0@lo:104: 00000100:00100000:3.0:1787707203.510773:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729709568:0@lo:103: 00000100:00100000:3.0:1787707203.510813:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707203.510894:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729709568 00000100:00100000:0.0:1787707203.510899:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729709568 00010000:00010000:0.0:1787707203.510930:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa029d5a00/0xc5f18d5f94ec0803 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec07fc expref: 13 pid: 5848 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707203.510956:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787707203.510963:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa05e65c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:3315:x1874546729709568:12345-0@lo:103: 00010000:00010000:0.0:1787707203.510974:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707203.510979:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa029d5a00/0xc5f18d5f94ec0803 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec07fc expref: 13 pid: 5848 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707203.510999:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa029d5a00/0xc5f18d5f94ec0803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec07fc expref: 13 pid: 5848 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707203.511012:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa029d5a00/0xc5f18d5f94ec0803 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec07fc expref: 13 pid: 5848 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707203.511025:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707203.511082:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa05e65c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:3315:x1874546729709568:12345-0@lo:103: Request processed in 119us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707203.511088:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787707203.511183:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729709568:0@lo:103: 00000100:00100000:1.0:1787707203.513575:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707203.513618:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707203.513714:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3f910700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874546729707648:192.168.204.46@tcp:104: 00000100:00100000:3.0:1787707203.513734:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707664896 00000100:00100000:0.0:1787707203.513740:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3f910000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874546729707776:192.168.204.46@tcp:104: 00000100:00100000:3.0:1787707203.513743:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707664896 00010000:00010000:3.0:1787707203.513781:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa029d4000/0xc5f18d5f94ec08c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b62 expref: 10 pid: 5850 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707203.513789:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0906 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707203.513819:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707665024 00000100:00100000:3.0:1787707203.513824:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707665024 00010000:00010000:3.0:1787707203.513836:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec08ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b69 expref: 11 pid: 5848 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707203.513852:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 19 00000100:00100000:2.0:1787707203.513902:0:5843:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787707203.513911:0:5843:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787707203.514003:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60f5ae37-220d-45d9-b012-b91715df156e+11:2361:x1874546707664896:12345-192.168.204.46@tcp:103: 00010000:00010000:1.0:1787707203.514019:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707203.514027:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa029d4000/0xc5f18d5f94ec08c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b62 expref: 11 pid: 5850 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.514038:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa029d4000/0xc5f18d5f94ec08c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b62 expref: 11 pid: 5850 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.514054:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa029d4000/0xc5f18d5f94ec08c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b62 expref: 11 pid: 5850 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707203.514087:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707203.514144:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60f5ae37-220d-45d9-b012-b91715df156e+10:2361:x1874546707664896:12345-192.168.204.46@tcp:103: Request processed in 281us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707203.517673:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 20 00000100:00100000:1.0:1787707203.517705:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 19 00000100:00100000:3.0:1787707203.517715:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60f5ae37-220d-45d9-b012-b91715df156e+10:2362:x1874546707665024:12345-192.168.204.46@tcp:103: 00010000:00010000:3.0:1787707203.517765:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707203.517776:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec08ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b69 expref: 10 pid: 5848 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.517796:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec08ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b69 expref: 9 pid: 5848 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.517816:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec08ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b69 expref: 9 pid: 5848 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.517835:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0906 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.517845:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0906 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.517861:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0906 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.517869:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0906 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.517876:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0906 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.517884:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0906 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.517890:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d5e00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707203.517894:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0906 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.517911:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0906 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.517942:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0906 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707203.517954:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707203.518022:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60f5ae37-220d-45d9-b012-b91715df156e+8:2362:x1874546707665024:12345-192.168.204.46@tcp:103: Request processed in 334us (4403us total) trans 0 rc 0/0 00010000:00010000:0.0:1787707203.518289:0:8445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0906 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707203.518300:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0906 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707203.518307:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0906 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707203.519249:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 20 00010000:00010000:0.0:1787707203.836250:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707203.896758:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787707203.896784:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729709696:0@lo:13: 00000100:00100000:2.0:1787707203.896853:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707203.896992:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729709696 00000100:00100000:1.0:1787707203.897000:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729709696 00000100:00100000:1.0:1787707203.897071:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787707203.897082:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729709696:12345-0@lo:13: 00002000:00000024:1.0:1787707203.897136:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787707203.897185:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729709696:12345-0@lo:13: Request processed in 105us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707203.897193:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787707203.897228:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa06ecce00 x1874546729709696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707203.897245:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729709696:0@lo:13: 00000100:00080000:2.0:1787707203.897337:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787707203.976432:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707203.976482:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707203.976520:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707203.976630:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707665408 00000100:00100000:3.0:1787707203.976641:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707665408 00000100:00100000:3.0:1787707203.976717:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707665280 00000100:00100000:3.0:1787707203.976721:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707665280 00000100:00100000:3.0:1787707203.976751:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 12 00000100:00100000:3.0:1787707203.976762:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2359:x1874546707665408:12345-192.168.204.46@tcp:400: 00000100:00100000:3.0:1787707203.976837:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2359:x1874546707665408:12345-192.168.204.46@tcp:400: Request processed in 77us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707203.976845:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 12 00000100:00100000:3.0:1787707203.976862:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 13 00000100:00100000:3.0:1787707203.976869:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2359:x1874546707665280:12345-192.168.204.46@tcp:400: 00000100:00100000:3.0:1787707203.976893:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2359:x1874546707665280:12345-192.168.204.46@tcp:400: Request processed in 25us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707203.976899:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 13 00000100:00100000:2.0:1787707203.977399:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707665152 00000100:00100000:2.0:1787707203.977406:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707665152 00000100:00100000:2.0:1787707203.977458:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 29 00000100:00100000:2.0:1787707203.977466:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2359:x1874546707665152:12345-192.168.204.46@tcp:400: 00000100:00100000:2.0:1787707203.977507:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2359:x1874546707665152:12345-192.168.204.46@tcp:400: Request processed in 43us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707203.977531:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 29 00000100:00080000:1.0:1787707203.978111:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787707203.978118:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787707203.978120:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787707204.857982:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787707205.306083:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787707205.306091:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfa3f9b5800 from 39 10000000:01000000:2.0:1787707205.306097:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787707205.306153:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa08746000/0xc5f18d5f94ec090d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707205.306165:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa08746000/0xc5f18d5f94ec090d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707205.306177:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa08746000/0xc5f18d5f94ec090d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707205.306205:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729709824:0@lo:101: 00000100:00100000:2.0:1787707205.306283:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707205.306356:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05df9600 going to sleep for 11 seconds 00000100:00100000:0.0:1787707205.306579:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729709824 00000100:00100000:0.0:1787707205.306588:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729709824 00000100:00100000:0.0:1787707205.306641:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787707205.306667:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+12:5853:x1874546729709824:12345-0@lo:101: 00010000:00010000:0.0:1787707205.306683:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707205.306698:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa3fcd3800/0xc5f18d5f94ec0914 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec090d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707205.306723:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa3fcd3800/0xc5f18d5f94ec0914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec090d expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707205.306753:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa3fcd3800/0xc5f18d5f94ec0914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec090d expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707205.306763:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3800, rc 0) 00000100:00100000:0.0:1787707205.306826:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:5853:x1874546729709824:12345-0@lo:101: Request processed in 177us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707205.306833:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787707205.307067:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729709824:0@lo:101: 00010000:00010000:2.0:1787707205.307083:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa08746000/0xc5f18d5f94ec090d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0914 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707205.307094:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa08746000/0xc5f18d5f94ec090d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0914 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707205.307151:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729709952:0@lo:501: 00000100:00100000:2.0:1787707205.307180:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707205.307222:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05df9600 going to sleep for 11 seconds 00000100:00100000:0.0:1787707205.307456:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729709952 00000100:00100000:0.0:1787707205.307461:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729709952 00000100:00100000:0.0:1787707205.307496:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787707205.307511:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:5853:x1874546729709952:12345-0@lo:501: 00000100:00100000:0.0:1787707205.307810:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:5853:x1874546729709952:12345-0@lo:501: Request processed in 305us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707205.307817:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787707205.308188:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729709952:0@lo:501: 00000100:00100000:2.0:1787707205.308231:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729710080:0@lo:503: 00000100:00100000:2.0:1787707205.308294:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707205.308326:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05df9600 going to sleep for 11 seconds 00000100:00100000:1.0:1787707205.308641:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729710080 00000100:00100000:1.0:1787707205.308647:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729710080 00000100:00100000:1.0:1787707205.308714:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787707205.308726:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:5853:x1874546729710080:12345-0@lo:503: 00000100:00100000:1.0:1787707205.308937:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:5853:x1874546729710080:12345-0@lo:503: Request processed in 215us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707205.308944:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787707205.309331:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729710080:0@lo:503: 00000100:00100000:3.0:1787707205.310021:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8463:1874546729710208:0@lo:502: 00000100:00100000:3.0:1787707205.310085:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707205.310126:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3f850240 going to sleep for 11 seconds 00000100:00100000:1.0:1787707205.310197:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729710208 00000100:00100000:1.0:1787707205.310203:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729710208 00000100:00100000:1.0:1787707205.310289:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787707205.310298:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:8463:x1874546729710208:12345-0@lo:502: 00000100:00100000:1.0:1787707205.310571:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:8463:x1874546729710208:12345-0@lo:502: Request processed in 274us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707205.310579:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787707205.310683:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8463:1874546729710208:0@lo:502: 00000100:00100000:3.0:1787707205.310727:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8463:1874546729710336:0@lo:502: 00000100:00100000:3.0:1787707205.310762:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707205.329154:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3f850240 going to sleep for 11 seconds 00000100:00100000:2.0:1787707205.337351:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729710336 00000100:00100000:2.0:1787707205.337381:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729710336 00000100:00100000:2.0:1787707205.337448:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787707205.337459:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:8463:x1874546729710336:12345-0@lo:502: 00000100:00100000:2.0:1787707205.338583:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:8463:x1874546729710336:12345-0@lo:502: Request processed in 1121us (27815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707205.338595:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787707205.338792:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8463:1874546729710336:0@lo:502: 00000040:00080000:3.0:1787707205.338829:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787707205.339062:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787707205.339083:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787707205.339094:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa08746000/0xc5f18d5f94ec090d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0914 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707205.339117:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa08746000/0xc5f18d5f94ec090d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0914 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707205.339129:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787707205.339132:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787707205.339136:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787707205.339170:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa08746e00/0xc5f18d5f94ec091b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707205.339179:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa08746e00/0xc5f18d5f94ec091b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707205.339263:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa08746e00/0xc5f18d5f94ec091b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707205.339284:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729710464:0@lo:101: 00000100:00100000:2.0:1787707205.339334:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707205.339394:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05df9180 going to sleep for 11 seconds 00000100:00100000:3.0:1787707205.339695:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729710464 00000100:00100000:3.0:1787707205.339702:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729710464 00000100:00100000:3.0:1787707205.339733:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787707205.339742:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+13:5853:x1874546729710464:12345-0@lo:101: 00010000:00010000:3.0:1787707205.339754:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707205.339767:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa00030c00/0xc5f18d5f94ec0922 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec091b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707205.339801:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa00030c00/0xc5f18d5f94ec0922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec091b expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707205.339811:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa00030c00/0xc5f18d5f94ec0922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec091b expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707205.339820:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa00030c00, rc 0) 00000100:00100000:3.0:1787707205.339857:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:5853:x1874546729710464:12345-0@lo:101: Request processed in 115us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707205.339864:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787707205.342464:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729710464:0@lo:101: 00010000:00010000:2.0:1787707205.342494:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa08746e00/0xc5f18d5f94ec091b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0922 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707205.342518:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa08746e00/0xc5f18d5f94ec091b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0922 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707205.342606:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729710592:0@lo:501: 00000100:00100000:2.0:1787707205.342951:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707205.342994:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05df9180 going to sleep for 11 seconds 00000100:00100000:3.0:1787707205.344674:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729710592 00000100:00100000:3.0:1787707205.344706:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729710592 00000100:00100000:3.0:1787707205.344771:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787707205.344788:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:5853:x1874546729710592:12345-0@lo:501: 00000100:00100000:3.0:1787707205.345915:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:5853:x1874546729710592:12345-0@lo:501: Request processed in 1124us (2960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707205.345928:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787707205.346088:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729710592:0@lo:501: 00000100:00100000:1.0:1787707205.346147:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ecdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729710720:0@lo:503: 00000100:00100000:1.0:1787707205.346202:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707205.346245:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1fad8180 going to sleep for 11 seconds 00000100:00100000:0.0:1787707205.346825:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729710720 00000100:00100000:0.0:1787707205.346834:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729710720 00000100:00100000:0.0:1787707205.346889:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787707205.346898:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:5853:x1874546729710720:12345-0@lo:503: 00000100:00100000:0.0:1787707205.347152:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:5853:x1874546729710720:12345-0@lo:503: Request processed in 254us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707205.347159:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787707205.347456:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ecdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729710720:0@lo:503: 00000100:00100000:3.0:1787707205.350145:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8464:1874546729710848:0@lo:502: 00000100:00100000:3.0:1787707205.350306:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707205.350878:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3f8506c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707205.351062:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729710848 00000100:00100000:1.0:1787707205.351071:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729710848 00000100:00100000:1.0:1787707205.351152:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787707205.351162:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:8464:x1874546729710848:12345-0@lo:502: 00000100:00100000:1.0:1787707205.351420:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:8464:x1874546729710848:12345-0@lo:502: Request processed in 259us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707205.351428:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787707205.351529:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8464:1874546729710848:0@lo:502: 00000020:01000000:0.0:1787707205.351572:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787707205.351586:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707205.351589:0:8464:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787707205.351596:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787707205.351640:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b00e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8464:1874546729710976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787707205.351699:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707205.352352:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f5e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787707205.352731:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729710976 00000100:00100000:3.0:1787707205.352738:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729710976 00000100:00100000:3.0:1787707205.352911:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787707205.352924:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:8464:x1874546729710976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787707205.353201:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:8464:x1874546729710976:12345-0@lo:502:llog_process_th.0 Request processed in 279us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707205.353209:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787707205.353421:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b00e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8464:1874546729710976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787707205.353453:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787707205.353461:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707205.353463:0:8464:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787707205.353468:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1787707205.353626:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787707205.353644:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787707205.353668:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa08746e00/0xc5f18d5f94ec091b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0922 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707205.353680:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa08746e00/0xc5f18d5f94ec091b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0922 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707205.353689:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787707205.353691:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfa34ab9800 from 39 10000000:01000000:0.0:1787707205.353695:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787707205.353724:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2400/0xc5f18d5f94ec0929 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707205.353732:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2400/0xc5f18d5f94ec0929 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707205.353742:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2400/0xc5f18d5f94ec0929 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707205.353762:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729711104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787707205.353813:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707205.353849:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f5e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707205.353912:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729711104 00000100:00100000:1.0:1787707205.353918:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729711104 00000100:00100000:0.0:1787707205.354316:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787707205.354324:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:5853:x1874546729711104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787707205.354334:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707205.354345:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa3fcd2c00/0xc5f18d5f94ec0930 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0929 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707205.354366:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa3fcd2c00/0xc5f18d5f94ec0930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0929 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707205.354394:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa3fcd2c00/0xc5f18d5f94ec0930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0929 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707205.354404:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2c00, rc 0) 00000100:00100000:0.0:1787707205.354498:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:5853:x1874546729711104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707205.354518:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787707205.354977:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729711104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787707205.354994:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2400/0xc5f18d5f94ec0929 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0930 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707205.355004:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2400/0xc5f18d5f94ec0929 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0930 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707205.355134:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729711232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787707205.355167:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707205.355341:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f5e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787707205.355479:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729711232 00000100:00100000:3.0:1787707205.355485:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729711232 00000100:00100000:3.0:1787707205.355856:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787707205.355867:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:5853:x1874546729711232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787707205.356271:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:5853:x1874546729711232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 405us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707205.356279:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787707205.356340:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729711232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787707205.356405:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ecdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729711360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787707205.356447:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707205.356669:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1fad8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787707205.356961:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729711360 00000100:00100000:0.0:1787707205.356968:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729711360 00000100:00100000:0.0:1787707205.356998:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787707205.357006:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:5853:x1874546729711360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787707205.357174:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:5853:x1874546729711360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707205.357193:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787707205.357341:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ecdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729711360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787707205.358172:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b00700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8465:1874546729711488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787707205.358309:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707205.358344:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f5e840 going to sleep for 11 seconds 00000100:00100000:3.0:1787707205.358405:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729711488 00000100:00100000:3.0:1787707205.358411:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729711488 00000100:00100000:3.0:1787707205.358444:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787707205.358451:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:8465:x1874546729711488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787707205.358962:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:8465:x1874546729711488:12345-0@lo:502:llog_process_th.0 Request processed in 510us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707205.358969:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787707205.359065:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b00700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8465:1874546729711488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787707205.359111:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ecdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8465:1874546729711616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787707205.359148:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707205.359178:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1fad8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787707205.359332:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729711616 00000100:00100000:0.0:1787707205.359338:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729711616 00000100:00100000:0.0:1787707205.359359:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787707205.359365:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:8465:x1874546729711616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787707205.359681:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:8465:x1874546729711616:12345-0@lo:502:llog_process_th.0 Request processed in 314us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707205.359688:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787707205.359765:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ecdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8465:1874546729711616:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787707205.359907:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787707205.360139:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787707205.360159:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787707205.360169:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2400/0xc5f18d5f94ec0929 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0930 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707205.360256:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2400/0xc5f18d5f94ec0929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0930 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707205.360268:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787707205.360270:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787707205.360273:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787707205.360302:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec0937 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707205.360310:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec0937 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707205.360320:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec0937 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707205.360338:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729711744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787707205.360421:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707205.360448:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f5ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787707205.360516:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729711744 00000100:00100000:3.0:1787707205.360523:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729711744 00000100:00100000:3.0:1787707205.360706:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787707205.360715:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:5853:x1874546729711744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787707205.360725:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707205.360738:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa00030e00/0xc5f18d5f94ec093e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0937 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707205.360758:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa00030e00/0xc5f18d5f94ec093e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0937 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707205.360769:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa00030e00/0xc5f18d5f94ec093e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0937 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707205.360857:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa00030e00, rc 0) 00000100:00100000:3.0:1787707205.360893:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:5853:x1874546729711744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707205.360900:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787707205.360991:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729711744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787707205.361003:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec0937 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec093e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707205.361012:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec0937 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec093e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707205.361062:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ecdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729711872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787707205.361088:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707205.361112:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1fad8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787707205.361153:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729711872 00000100:00100000:3.0:1787707205.361157:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729711872 00000100:00100000:3.0:1787707205.361175:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787707205.361257:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:5853:x1874546729711872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787707205.361732:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:5853:x1874546729711872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 549us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707205.361750:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787707205.361925:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ecdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729711872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787707205.361962:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ecdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729712000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787707205.362003:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707205.362036:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1fad8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787707205.362114:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729712000 00000100:00100000:3.0:1787707205.362119:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729712000 00000100:00100000:3.0:1787707205.362155:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787707205.362163:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:5853:x1874546729712000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787707205.362895:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:5853:x1874546729712000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 729us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707205.362905:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787707205.363051:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ecdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729712000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787707205.364035:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8466:1874546729712128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787707205.364101:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707205.364147:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05df9600 going to sleep for 11 seconds 00000100:00100000:3.0:1787707205.364271:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729712128 00000100:00100000:3.0:1787707205.364278:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729712128 00000100:00100000:3.0:1787707205.364326:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787707205.364336:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:8466:x1874546729712128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787707205.364762:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:8466:x1874546729712128:12345-0@lo:502:llog_process_th.0 Request processed in 426us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707205.364768:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787707205.364938:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8466:1874546729712128:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787707205.364964:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787707205.364974:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707205.364977:0:8466:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787707205.364983:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787707205.365007:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8466:1874546729712256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787707205.365041:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707205.365073:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05df9600 going to sleep for 11 seconds 00000100:00100000:3.0:1787707205.365121:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729712256 00000100:00100000:3.0:1787707205.365127:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729712256 00000100:00100000:3.0:1787707205.365256:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787707205.365265:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:8466:x1874546729712256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787707205.365430:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:8466:x1874546729712256:12345-0@lo:502:llog_process_th.0 Request processed in 166us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707205.365437:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787707205.365517:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8466:1874546729712256:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787707205.365535:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787707205.365550:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707205.365557:0:8466:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787707205.365561:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1787707205.368892:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787707205.368929:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787707205.368958:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec0937 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec093e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707205.368972:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec0937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec093e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707205.368986:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787707205.368989:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfa02b55800 from 39 10000000:01000000:1.0:1787707205.368992:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787707205.369030:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4e00/0xc5f18d5f94ec0945 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707205.369039:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4e00/0xc5f18d5f94ec0945 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707205.369051:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4e00/0xc5f18d5f94ec0945 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707205.369076:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ecdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729712384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787707205.369146:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707205.369284:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729712384 00000100:00100000:2.0:1787707205.369291:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729712384 00000100:00100000:2.0:1787707205.369336:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787707205.369346:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:5853:x1874546729712384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787707205.369361:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707205.369392:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa08747e00/0xc5f18d5f94ec094c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0945 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707205.369416:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa08747e00/0xc5f18d5f94ec094c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0945 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707205.369427:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa08747e00/0xc5f18d5f94ec094c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0945 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707205.369436:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa08747e00, rc 0) 00000100:00100000:2.0:1787707205.369474:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729712384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707205.369481:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787707205.369853:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1fad8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787707205.369875:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ecdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729712384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787707205.369889:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4e00/0xc5f18d5f94ec0945 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec094c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707205.369899:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4e00/0xc5f18d5f94ec0945 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec094c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707205.369950:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ecdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729712512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787707205.369989:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707205.370002:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1fad8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787707205.370018:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729712512 00000100:00100000:1.0:1787707205.370022:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729712512 00000100:00100000:1.0:1787707205.370043:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787707205.370050:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729712512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787707205.371153:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729712512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1100us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707205.371161:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787707205.371879:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ecdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729712512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787707205.371931:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729712640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787707205.371985:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707205.372065:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05df9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787707205.372101:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729712640 00000100:00100000:0.0:1787707205.372108:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729712640 00000100:00100000:0.0:1787707205.372295:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787707205.372305:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729712640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787707205.372692:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729712640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 388us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707205.372700:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787707205.373280:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729712640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787707205.374164:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8467:1874546729712768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787707205.374312:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707205.374412:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3f850780 going to sleep for 11 seconds 00000100:00100000:2.0:1787707205.374744:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729712768 00000100:00100000:2.0:1787707205.374751:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729712768 00000100:00100000:2.0:1787707205.374919:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787707205.374929:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:8467:x1874546729712768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787707205.375408:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8467:1874546729712768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787707205.375457:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8467:1874546729712896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787707205.375494:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707205.375673:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:8467:x1874546729712768:12345-0@lo:502:llog_process_th.0 Request processed in 251us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707205.375684:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787707205.376036:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3f850780 going to sleep for 11 seconds 00000100:00100000:2.0:1787707205.376131:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729712896 00000100:00100000:2.0:1787707205.376136:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729712896 00000100:00100000:2.0:1787707205.376160:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787707205.376167:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:8467:x1874546729712896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787707205.376346:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:8467:x1874546729712896:12345-0@lo:502:llog_process_th.0 Request processed in 179us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707205.376352:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787707205.376486:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8467:1874546729712896:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787707205.376515:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787707205.376747:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787707205.376765:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787707205.376834:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4e00/0xc5f18d5f94ec0945 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec094c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707205.376845:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4e00/0xc5f18d5f94ec0945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec094c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707205.376853:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787707205.376855:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787707205.376858:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787707205.376884:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa08746200/0xc5f18d5f94ec0953 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707205.376892:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa08746200/0xc5f18d5f94ec0953 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707205.376901:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa08746200/0xc5f18d5f94ec0953 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707205.376928:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729713024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787707205.376960:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707205.377025:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f2580c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707205.377101:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729713024 00000100:00100000:1.0:1787707205.377107:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729713024 00000100:00100000:0.0:1787707205.377296:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787707205.377306:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729713024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787707205.377316:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707205.377327:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa3fcd3c00/0xc5f18d5f94ec095a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0953 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707205.377347:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa3fcd3c00/0xc5f18d5f94ec095a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0953 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707205.377356:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa3fcd3c00/0xc5f18d5f94ec095a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0953 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707205.377363:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3c00, rc 0) 00000100:00100000:0.0:1787707205.377430:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729713024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707205.377436:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787707205.377520:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729713024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787707205.377533:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa08746200/0xc5f18d5f94ec0953 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec095a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707205.377552:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa08746200/0xc5f18d5f94ec0953 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec095a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707205.377592:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729713152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787707205.377618:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707205.377973:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f2580c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707205.378005:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729713152 00000100:00100000:1.0:1787707205.378010:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729713152 00000100:00100000:1.0:1787707205.378034:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787707205.378040:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729713152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787707205.378294:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729713152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707205.378301:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787707205.378445:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729713152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787707205.378478:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729713280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787707205.378532:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707205.378679:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f2580c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707205.378729:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729713280 00000100:00100000:1.0:1787707205.378733:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729713280 00000100:00100000:1.0:1787707205.378752:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787707205.378758:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729713280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787707205.378974:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729713280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 215us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707205.378981:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787707205.379046:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729713280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787707205.379501:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8468:1874546729713408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787707205.379561:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707205.379588:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f258300 going to sleep for 11 seconds 00000100:00100000:1.0:1787707205.379945:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729713408 00000100:00100000:1.0:1787707205.379951:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729713408 00000100:00100000:1.0:1787707205.379983:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787707205.379989:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:8468:x1874546729713408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787707205.380174:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:8468:x1874546729713408:12345-0@lo:502:llog_process_th.0 Request processed in 184us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707205.380192:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787707205.380317:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8468:1874546729713408:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787707205.380341:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787707205.380355:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707205.380358:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787707205.380365:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787707205.380421:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8468:1874546729713536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787707205.380455:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707205.380471:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f258300 going to sleep for 11 seconds 00000100:00100000:1.0:1787707205.380531:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729713536 00000100:00100000:1.0:1787707205.380535:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729713536 00000100:00100000:1.0:1787707205.380671:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787707205.380679:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:8468:x1874546729713536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787707205.380880:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:8468:x1874546729713536:12345-0@lo:502:llog_process_th.0 Request processed in 202us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707205.380888:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787707205.380955:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8468:1874546729713536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787707205.380972:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787707205.380976:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707205.380978:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787707205.380982:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787707205.381842:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1787707205.381861:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787707205.381873:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa08746200/0xc5f18d5f94ec0953 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec095a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707205.381886:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa08746200/0xc5f18d5f94ec0953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec095a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707205.381975:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787707205.381979:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cfa05848000 from 1 10000000:01000000:0.0:1787707205.381982:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787707205.382019:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2a00/0xc5f18d5f94ec0961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707205.382027:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2a00/0xc5f18d5f94ec0961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707205.382036:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2a00/0xc5f18d5f94ec0961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707205.382054:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729713664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787707205.382095:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707205.382158:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f5eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787707205.382260:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729713664 00000100:00100000:1.0:1787707205.382266:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729713664 00000100:00100000:1.0:1787707205.382336:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787707205.382345:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729713664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787707205.382356:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707205.382395:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa029d4200/0xc5f18d5f94ec0968 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0961 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707205.382430:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa029d4200/0xc5f18d5f94ec0968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0961 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707205.382441:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa029d4200/0xc5f18d5f94ec0968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0961 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707205.382450:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d4200, rc 0) 00000100:00100000:1.0:1787707205.382493:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:5853:x1874546729713664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707205.382499:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787707205.382586:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729713664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787707205.382600:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2a00/0xc5f18d5f94ec0961 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0968 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707205.382608:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2a00/0xc5f18d5f94ec0961 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0968 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707205.382669:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729713792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787707205.382696:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707205.383110:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f5eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787707205.383174:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729713792 00000100:00100000:3.0:1787707205.383245:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729713792 00000100:00100000:2.0:1787707205.383946:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787707205.383957:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:5853:x1874546729713792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787707205.384245:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:5853:x1874546729713792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 289us (1546us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787707205.384253:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787707205.384397:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729713792:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787707205.384431:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787707205.384441:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2a00/0xc5f18d5f94ec0961 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0968 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707205.384449:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2a00/0xc5f18d5f94ec0961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0968 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707205.882307:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707205.949188:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729713920:0@lo:400:kworker.0 00000100:00100000:1.0:1787707205.949271:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707205.949349:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729713920 00000100:00100000:0.0:1787707205.949359:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729713920 00000100:00100000:0.0:1787707205.949437:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787707205.949447:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729713920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707205.949500:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729713920:12345-0@lo:400:kworker.0 Request processed in 55us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707205.949708:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729713920:0@lo:400:kworker.0 00000100:00100000:0.0:1787707205.949981:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787707205.950168:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729714048:0@lo:400:kworker.0 00000100:00100000:2.0:1787707205.950286:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707205.950321:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787707205.950327:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729714176:0@lo:400:kworker.0 00000100:00100000:2.0:1787707205.950354:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707205.950448:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729714432:0@lo:400:kworker.0 00000100:00100000:1.0:1787707205.950475:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707205.950508:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787707205.950513:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874546729714304:0@lo:400:kworker.0 00000100:00100000:3.0:1787707205.950686:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729714048 00000100:00100000:3.0:1787707205.950693:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729714048 00000100:00100000:3.0:1787707205.950755:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787707205.951003:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787707205.951046:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787707205.951058:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729714176 00000100:00100000:1.0:1787707205.951062:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729714176 00000100:00100000:1.0:1787707205.951097:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729714432 00000100:00100000:1.0:1787707205.951101:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729714432 00000100:00100000:1.0:1787707205.951122:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787707205.951129:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729714176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707205.951175:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729714176:12345-0@lo:400:kworker.0 Request processed in 46us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707205.951181:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787707205.951197:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787707205.951435:0:5857:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787707205.951446:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:0.0:1787707205.951472:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787707205.951475:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787707205.951696:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729714048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707205.951753:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729714048:12345-0@lo:400:kworker.0 Request processed in 990us (1466us total) trans 0 rc 0/0 00010000:00080000:2.0:1787707205.952027:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acb6300 x1874546729714176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707205.952043:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729714176:0@lo:400:kworker.0 00000100:00100000:2.0:1787707205.952057:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729714048:0@lo:400:kworker.0 00000100:00100000:2.0:1787707205.952102:0:5858:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787707205.952122:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729714304 00000100:00100000:2.0:1787707205.952127:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729714304 00000100:00080000:0.0:1787707205.952322:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707205.952982:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787707205.953303:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729714432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707205.953409:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729714432:12345-0@lo:400:kworker.0 Request processed in 2206us (2931us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707205.953418:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787707205.954001:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787707205.954014:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874546729714304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707205.954061:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874546729714304:12345-0@lo:400:kworker.0 Request processed in 51us (3058us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707205.954067:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787707205.954485:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874546729714304:0@lo:400:kworker.0 00010000:00080000:0.0:1787707205.954502:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acb6a00 x1874546729714432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707205.954513:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729714432:0@lo:400:kworker.0 00000100:00100000:1.0:1787707206.457099:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787707206.457133:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729714560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787707206.457203:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707206.457701:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729714560 00000100:00100000:3.0:1787707206.457709:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729714560 00000100:00100000:3.0:1787707206.457782:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787707206.457793:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729714560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787707206.457841:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707206.457900:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729714560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707206.457908:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787707206.458063:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa35b01500 x1874546729714560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707206.458084:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729714560:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787707206.905115:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707207.928731:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707208.953768:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707209.016622:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729714688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787707209.016708:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707209.016846:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729714688 00000100:00100000:1.0:1787707209.016856:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729714688 00000100:00100000:1.0:1787707209.016937:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787707209.016947:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729714688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787707209.016992:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787707209.017040:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729714688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707209.017047:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787707209.017086:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa06ecd880 x1874546729714688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707209.017105:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729714688:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787707209.017768:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787707209.091652:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707209.091697:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707209.091733:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707209.092132:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707665536 00000100:00100000:2.0:1787707209.092141:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707665536 00000100:00100000:2.0:1787707209.092193:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 164 00000100:00100000:2.0:1787707209.092204:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+8:5602:x1874546707665536:12345-192.168.204.46@tcp:101: 00010000:00010000:2.0:1787707209.092220:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707209.092237:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa08747400/0xc5f18d5f94ec096f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9bcb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707209.092267:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa08747400/0xc5f18d5f94ec096f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9bcb expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707209.092279:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa08747400/0xc5f18d5f94ec096f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9bcb expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707209.092289:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa08747400, rc 0) 00000100:00100000:2.0:1787707209.092361:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+9:5602:x1874546707665536:12345-192.168.204.46@tcp:101: Request processed in 159us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707209.092396:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 164 00000100:00100000:1.0:1787707209.092650:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707209.092767:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707665664 00000100:00100000:3.0:1787707209.092785:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707665664 00000100:00100000:3.0:1787707209.092845:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 33 00000100:00100000:3.0:1787707209.092854:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2361:x1874546707665664:12345-192.168.204.46@tcp:400: 00000100:00100000:3.0:1787707209.092893:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2361:x1874546707665664:12345-192.168.204.46@tcp:400: Request processed in 41us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707209.092900:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 33 00000100:00080000:1.0:1787707209.093184:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787707209.093431:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707665920 00000100:00100000:2.0:1787707209.093437:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707665920 00000100:00100000:2.0:1787707209.093482:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707665792 00000100:00100000:2.0:1787707209.093486:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707665792 00000100:00100000:2.0:1787707209.093529:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 16 00000100:00100000:2.0:1787707209.093537:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2361:x1874546707665920:12345-192.168.204.46@tcp:400: 00000100:00100000:1.0:1787707209.093692:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 17 00000100:00100000:1.0:1787707209.093702:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2361:x1874546707665792:12345-192.168.204.46@tcp:400: 00000100:00080000:3.0:1787707209.099701:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787707209.099712:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787707209.100241:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707209.100294:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707666048 00000100:00100000:3.0:1787707209.100303:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707666048 00000100:00100000:3.0:1787707209.100350:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 165 00000100:00100000:3.0:1787707209.100360:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+9:5602:x1874546707666048:12345-192.168.204.46@tcp:501: 00000100:00100000:3.0:1787707209.100679:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+9:5602:x1874546707666048:12345-192.168.204.46@tcp:501: Request processed in 319us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707209.100687:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 165 00000100:00100000:1.0:1787707209.105982:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2361:x1874546707665792:12345-192.168.204.46@tcp:400: Request processed in 12268us (14160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707209.105998:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 17 00000100:00100000:2.0:1787707209.106450:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2361:x1874546707665920:12345-192.168.204.46@tcp:400: Request processed in 12911us (14713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707209.106459:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 16 00000100:00100000:1.0:1787707209.109161:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707209.109257:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707666176 00000100:00100000:2.0:1787707209.109266:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707666176 00000100:00100000:2.0:1787707209.109315:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 166 00000100:00100000:2.0:1787707209.109324:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+9:5602:x1874546707666176:12345-192.168.204.46@tcp:503: 00000100:00100000:2.0:1787707209.109671:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+9:5602:x1874546707666176:12345-192.168.204.46@tcp:503: Request processed in 347us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707209.109679:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 166 00000100:00100000:0.0:1787707209.115431:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707209.115649:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707666304 00000100:00100000:3.0:1787707209.115658:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707666304 00000100:00100000:3.0:1787707209.115718:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 167 00000100:00100000:3.0:1787707209.115728:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+9:6097:x1874546707666304:12345-192.168.204.46@tcp:502: 00000100:00100000:3.0:1787707209.115991:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+9:6097:x1874546707666304:12345-192.168.204.46@tcp:502: Request processed in 264us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707209.115999:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 167 00000100:00100000:3.0:1787707209.117997:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707209.118079:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707666432 00000100:00100000:2.0:1787707209.118087:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707666432 00000100:00100000:2.0:1787707209.118127:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 168 00000100:00100000:2.0:1787707209.118135:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07314450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+9:6097:x1874546707666432:12345-192.168.204.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787707209.118345:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07314450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+9:6097:x1874546707666432:12345-192.168.204.46@tcp:502:llog_process_th.0 Request processed in 210us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707209.118353:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 168 00000100:00100000:1.0:1787707209.120604:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707209.121168:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707666560 00000100:00100000:2.0:1787707209.121176:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707666560 00000100:00100000:2.0:1787707209.121231:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 169 00000100:00100000:2.0:1787707209.121240:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07316850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+9:5602:x1874546707666560:12345-192.168.204.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787707209.121254:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707209.121269:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa08747a00/0xc5f18d5f94ec0976 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9bd2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707209.121307:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa08747a00/0xc5f18d5f94ec0976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9bd2 expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707209.121317:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa08747a00/0xc5f18d5f94ec0976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9bd2 expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707209.121325:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa08747a00, rc 0) 00000100:00100000:2.0:1787707209.121404:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07316850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+10:5602:x1874546707666560:12345-192.168.204.46@tcp:101:ll_cfg_requeue.0 Request processed in 131us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707209.121410:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 169 00000100:00100000:0.0:1787707209.123235:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707209.123299:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707666688 00000100:00100000:3.0:1787707209.123307:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707666688 00000100:00100000:3.0:1787707209.123347:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 170 00000100:00100000:3.0:1787707209.123356:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07314050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+10:5602:x1874546707666688:12345-192.168.204.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787707209.123630:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07314050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+10:5602:x1874546707666688:12345-192.168.204.46@tcp:501:ll_cfg_requeue.0 Request processed in 274us (400us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787707209.123638:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 170 00010000:00010000:0.0:1787707209.979073:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707211.000578:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707211.065641:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729714944:0@lo:400:kworker.0 00000100:00100000:3.0:1787707211.065733:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707211.065793:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729715456:0@lo:400:kworker.0 00000100:00100000:3.0:1787707211.065821:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707211.065855:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787707211.065862:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729714816:0@lo:400:kworker.0 00000100:00100000:1.0:1787707211.066001:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729715200:0@lo:400:kworker.0 00000100:00100000:1.0:1787707211.068498:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707211.068569:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787707211.068584:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874546729715072:0@lo:400:kworker.0 00000100:00100000:1.0:1787707211.068621:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707211.068667:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729715456 00000100:00100000:1.0:1787707211.068694:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729715456 00000100:00100000:1.0:1787707211.068762:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729715200 00000100:00100000:1.0:1787707211.068766:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729715200 00000100:00100000:1.0:1787707211.068792:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787707211.068801:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729715456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707211.068864:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729715456:12345-0@lo:400:kworker.0 Request processed in 63us (3042us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707211.068872:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787707211.068891:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787707211.068898:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729715200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707211.068930:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729715200:12345-0@lo:400:kworker.0 Request processed in 33us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707211.068937:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787707211.068958:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729714944 00000100:00100000:1.0:1787707211.068963:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729714944 00000100:00100000:1.0:1787707211.068989:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729715072 00000100:00100000:1.0:1787707211.068992:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729715072 00000100:00100000:1.0:1787707211.069019:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787707211.069027:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729714944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707211.069062:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729714944:12345-0@lo:400:kworker.0 Request processed in 36us (3329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707211.069068:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787707211.069079:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787707211.069086:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874546729715072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707211.069114:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874546729715072:12345-0@lo:400:kworker.0 Request processed in 28us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707211.069120:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1787707211.069146:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787707211.069151:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787707211.069153:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787707211.069202:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874546729715072:0@lo:400:kworker.0 00010000:00080000:1.0:1787707211.069217:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acb5180 x1874546729715200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707211.069228:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729715200:0@lo:400:kworker.0 00000100:00100000:3.0:1787707211.070479:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707211.070770:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874546729715328:0@lo:400:kworker.0 00000100:00100000:0.0:1787707211.070770:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729714816 00000100:00100000:0.0:1787707211.070778:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729714816 00000100:00100000:0.0:1787707211.070833:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787707211.070843:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07316050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3317:x1874546729714816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707211.073752:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707211.075094:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729715328 00000100:00100000:2.0:1787707211.075112:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729715328 00000100:00100000:2.0:1787707211.075210:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787707211.075223:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874546729715328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707211.075314:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874546729715328:12345-0@lo:400:kworker.0 Request processed in 94us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707211.075322:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1787707211.075349:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707211.077356:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07316050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3317:x1874546729714816:12345-0@lo:400:kworker.0 Request processed in 6501us (6868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707211.077396:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787707211.077585:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874546729715328:0@lo:400:kworker.0 00000100:00100000:3.0:1787707211.077604:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729714944:0@lo:400:kworker.0 00010000:00080000:3.0:1787707211.077623:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acb6300 x1874546729715456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707211.077635:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729715456:0@lo:400:kworker.0 00000100:00100000:3.0:1787707211.077676:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729714816:0@lo:400:kworker.0 00000020:00000080:3.0:1787707211.536960:0:8507:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff212a54c0 20000000:00000080:3.0:1787707211.536994:0:8507:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cfa3f958c00 uarg=0000000000000000 20000000:01000000:3.0:1787707211.537048:0:8507:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787707211.537056:0:8507:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787707211.537062:0:8507:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787707211.541588:0:8508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787707211.543293:0:8507:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787707211.554216:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787707211.554301:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787707211.554400:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787707211.554435:0:8507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787707211.554463:0:8507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfa029d5000/0xc5f18d5f94ec097d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.554495:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa00030800/0xc5f18d5f94ec06f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec06eb expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.554505:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa421fc600/0xc5f18d5f94ec0754 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec074d expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.554513:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa421fc800/0xc5f18d5f94ec081f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0818 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.554524:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa013fde00/0xc5f18d5f94ec08dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b9a expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.554533:0:8507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfa029d5000/0xc5f18d5f94ec097d lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.554599:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa013fde00/0xc5f18d5f94ec08dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b9a expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.554628:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfa013fde00/0xc5f18d5f94ec08dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b9a expref: 9 pid: 5851 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707211.554650:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06eced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1874546729715584:192.168.204.46@tcp:104: 00010000:00010000:1.0:1787707211.554807:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa421fc800/0xc5f18d5f94ec081f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec0818 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.554816:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa421fc800/0xc5f18d5f94ec081f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0818 expref: 18 pid: 5848 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707211.554827:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ece300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1874546729715712:0@lo:104: 00000100:00100000:1.0:1787707211.554877:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787707211.554922:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa421fc600/0xc5f18d5f94ec0754 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec074d expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.554932:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa421fc600/0xc5f18d5f94ec0754 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec074d expref: 18 pid: 5851 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707211.554941:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1874546729715840:0@lo:104: 00000100:00100000:1.0:1787707211.554967:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707211.555013:0:5839:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787707211.555027:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729715712 00000100:00100000:1.0:1787707211.555036:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729715712 00000100:00100000:1.0:1787707211.555082:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729715840 00000100:00100000:1.0:1787707211.555085:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729715840 00000100:00100000:1.0:1787707211.555101:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787707211.555111:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+4:8507:x1874546729715712:12345-0@lo:104: 00010000:00010000:1.0:1787707211.555127:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0818 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec081f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.555188:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787707211.555194:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+4:8507:x1874546729715712:12345-0@lo:104: Request processed in 84us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707211.555202:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787707211.555222:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787707211.555229:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5b0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:8507:x1874546729715840:12345-0@lo:104: 00010000:00010000:1.0:1787707211.555237:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa00031c00/0xc5f18d5f94ec074d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0754 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.555266:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787707211.555271:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5b0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:8507:x1874546729715840:12345-0@lo:104: Request processed in 43us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707211.555277:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1787707211.555329:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa00030800/0xc5f18d5f94ec06f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec06eb expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.555338:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa00030800/0xc5f18d5f94ec06f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec06eb expref: 18 pid: 5850 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707211.555345:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1874546729715968:0@lo:104: 00000100:00100000:1.0:1787707211.555391:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707211.555412:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729715968 00000100:00100000:1.0:1787707211.555416:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729715968 00000100:00100000:1.0:1787707211.555433:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787707211.555438:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:8507:x1874546729715968:12345-0@lo:104: 00010000:00010000:1.0:1787707211.555446:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd200/0xc5f18d5f94ec06eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec06f2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.555491:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787707211.555496:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:8507:x1874546729715968:12345-0@lo:104: Request processed in 58us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707211.555502:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787707211.555520:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787707211.555526:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0818 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec081f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.555533:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d5400 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:1.0:1787707211.555550:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0818 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec081f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.555561:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0818 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec081f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787707211.555569:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0818 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec081f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707211.555575:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787707211.555608:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0818 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec081f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.555615:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787707211.555638:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0818 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec081f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.555645:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5400/0xc5f18d5f94ec0818 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec081f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.555673:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787707211.555676:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa00031c00/0xc5f18d5f94ec074d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0754 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.555683:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa00031c00 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:1.0:1787707211.555686:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa00031c00/0xc5f18d5f94ec074d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec0754 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.555693:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa00031c00/0xc5f18d5f94ec074d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec0754 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787707211.555700:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa00031c00/0xc5f18d5f94ec074d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec0754 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707211.555705:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787707211.555720:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa00031c00/0xc5f18d5f94ec074d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0754 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.555726:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787707211.555733:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa00031c00/0xc5f18d5f94ec074d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0754 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.555739:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa00031c00/0xc5f18d5f94ec074d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0754 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.555751:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787707211.555754:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd200/0xc5f18d5f94ec06eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec06f2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.555770:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd200 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:1.0:1787707211.555774:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd200/0xc5f18d5f94ec06eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec06f2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.555781:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd200/0xc5f18d5f94ec06eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec06f2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787707211.555787:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd200/0xc5f18d5f94ec06eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec06f2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707211.555792:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787707211.555807:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd200/0xc5f18d5f94ec06eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec06f2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.555813:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787707211.555833:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd200/0xc5f18d5f94ec06eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec06f2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.555840:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd200/0xc5f18d5f94ec06eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec06f2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.555856:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707211.555858:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707211.555860:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707211.555887:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729716096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787707211.555920:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707211.555943:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787707211.555949:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729716224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787707211.555979:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707211.556009:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729716352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787707211.556032:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707211.556062:0:8507:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1fad80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707211.556087:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ece300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1874546729715712:0@lo:104: 00000100:00100000:1.0:1787707211.556096:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1874546729715840:0@lo:104: 00000100:00100000:1.0:1787707211.556102:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1874546729715968:0@lo:104: 00000100:00100000:1.0:1787707211.556151:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729716096 00000100:00100000:1.0:1787707211.556155:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729716096 00010000:00010000:1.0:1787707211.556176:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa421fc800/0xc5f18d5f94ec081f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0818 expref: 19 pid: 5848 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707211.556196:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729716224 00000100:00100000:1.0:1787707211.556200:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729716224 00010000:00010000:1.0:1787707211.556210:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa421fc600/0xc5f18d5f94ec0754 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec074d expref: 20 pid: 5851 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707211.556220:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729716352 00000100:00100000:1.0:1787707211.556223:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729716352 00010000:00010000:1.0:1787707211.556232:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa00030800/0xc5f18d5f94ec06f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec06eb expref: 21 pid: 5850 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707211.556244:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787707211.556250:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+21:3314:x1874546729716096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787707211.556261:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707211.556267:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa421fc800/0xc5f18d5f94ec081f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0818 expref: 21 pid: 5848 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.556277:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa421fc800/0xc5f18d5f94ec081f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0818 expref: 21 pid: 5848 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.556302:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa421fc800/0xc5f18d5f94ec081f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec0818 expref: 21 pid: 5848 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.556318:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707211.556346:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+20:3314:x1874546729716096:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707211.556353:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787707211.556366:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787707211.556394:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729716224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787707211.556403:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707211.556407:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa421fc600/0xc5f18d5f94ec0754 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec074d expref: 19 pid: 5851 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.556415:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa421fc600/0xc5f18d5f94ec0754 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec074d expref: 19 pid: 5851 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.556425:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa421fc600/0xc5f18d5f94ec0754 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec074d expref: 19 pid: 5851 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.556434:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707211.556457:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:3314:x1874546729716224:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707211.556463:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787707211.556476:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787707211.556482:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:3316:x1874546729716352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787707211.556490:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707211.556494:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa00030800/0xc5f18d5f94ec06f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec06eb expref: 17 pid: 5850 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707211.556942:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729716224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787707211.556952:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729716096:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787707211.557684:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707211.557692:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707211.566012:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa00030800/0xc5f18d5f94ec06f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec06eb expref: 17 pid: 5850 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.566040:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa00030800/0xc5f18d5f94ec06f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec06eb expref: 17 pid: 5850 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707211.566061:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707211.566145:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:3316:x1874546729716352:12345-0@lo:103:ldlm_bl.0 Request processed in 9660us (10110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707211.566157:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787707211.566807:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06eced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1874546729715584:192.168.204.46@tcp:104: 00010000:00010000:3.0:1787707211.566848:0:8507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfa029d5000/0xc5f18d5f94ec097d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707211.567121:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729716352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787707211.571161:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707211.571921:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707666816 00000100:00100000:2.0:1787707211.571937:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707666816 00010000:00010000:2.0:1787707211.571997:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa013fde00/0xc5f18d5f94ec08dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b9a expref: 10 pid: 5851 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707211.572076:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 24 00000100:00100000:2.0:1787707211.572089:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60f5ae37-220d-45d9-b012-b91715df156e+10:2361:x1874546707666816:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787707211.572112:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707211.572120:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa013fde00/0xc5f18d5f94ec08dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b9a expref: 10 pid: 5851 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707211.572138:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa013fde00/0xc5f18d5f94ec08dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b9a expref: 10 pid: 5851 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707211.572163:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa013fde00/0xc5f18d5f94ec08dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b9a expref: 10 pid: 5851 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707211.572191:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfa029d5000/0xc5f18d5f94ec097d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707211.572202:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa029d5000/0xc5f18d5f94ec097d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707211.572226:0:8450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa029d5000/0xc5f18d5f94ec097d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707211.572234:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa029d5000/0xc5f18d5f94ec097d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707211.572242:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfa029d5000/0xc5f18d5f94ec097d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707211.572250:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfa029d5000/0xc5f18d5f94ec097d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707211.572268:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d5000 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707211.572274:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfa029d5000/0xc5f18d5f94ec097d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707211.572299:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfa029d5000/0xc5f18d5f94ec097d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707211.572318:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfa029d5000/0xc5f18d5f94ec097d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707211.572333:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707211.572889:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60f5ae37-220d-45d9-b012-b91715df156e+9:2361:x1874546707666816:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 800us (1741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707211.572911:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 24 00010000:00010000:0.0:1787707211.573992:0:8507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfa029d5000/0xc5f18d5f94ec097d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707211.574009:0:8507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfa029d5000/0xc5f18d5f94ec097d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707211.574017:0:8507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa029d5000/0xc5f18d5f94ec097d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707211.579993:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729716480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787707211.580093:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707211.580173:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729716480 00000100:00100000:0.0:1787707211.580183:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729716480 00000100:00100000:0.0:1787707211.580265:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787707211.580277:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729716480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787707211.580324:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707211.580400:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729716480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707211.580409:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1787707211.580859:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa35b01c00 x1874546729716480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707211.581043:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729716480:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787707212.026547:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707213.048899:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787707213.049933:0:5853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787707213.049940:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfa3f9b5800 from 4 10000000:01000000:0.0:1787707213.049945:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787707213.050004:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0984 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707213.050029:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0984 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707213.050044:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0984 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707213.050077:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729716608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787707213.050168:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707213.050224:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787707213.050289:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729716608 00000100:00100000:2.0:1787707213.050299:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729716608 00000100:00100000:2.0:1787707213.050366:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787707213.050561:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:5853:x1874546729716608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787707213.050577:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707213.050593:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa08746800/0xc5f18d5f94ec098b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0984 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707213.050620:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa08746800/0xc5f18d5f94ec098b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0984 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707213.050631:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa08746800/0xc5f18d5f94ec098b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0984 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707213.050642:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa08746800, rc 0) 00000100:00100000:2.0:1787707213.050700:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729716608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707213.050715:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787707213.051658:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729716608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787707213.051694:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0984 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec098b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707213.051706:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0984 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec098b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707213.051800:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729716736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787707213.051842:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707213.051883:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1fad8540 going to sleep for 11 seconds 00000100:00100000:0.0:1787707213.054158:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729716736 00000100:00100000:0.0:1787707213.054242:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729716736 00000100:00100000:0.0:1787707213.054531:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787707213.054547:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729716736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787707213.055297:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729716736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 751us (3450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707213.055307:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787707213.055439:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729716736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787707213.055507:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729716864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787707213.055572:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707213.055609:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1fad8540 going to sleep for 11 seconds 00000100:00100000:3.0:1787707213.057607:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729716864 00000100:00100000:3.0:1787707213.057623:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729716864 00000100:00100000:3.0:1787707213.057694:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787707213.057707:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07314850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729716864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787707213.060170:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07314850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729716864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2451us (4582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707213.060190:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787707213.060315:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729716864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787707213.066543:0:8552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8552:1874546729716992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787707213.066650:0:8552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707213.066872:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729716992 00000100:00100000:0.0:1787707213.066882:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729716992 00000100:00100000:0.0:1787707213.066942:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787707213.066952:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07316450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:8552:x1874546729716992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787707213.067216:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07316450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:8552:x1874546729716992:12345-0@lo:502:llog_process_th.0 Request processed in 264us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707213.067224:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787707213.067305:0:8552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707213.067329:0:8552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8552:1874546729716992:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787707213.067362:0:8552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787707213.067391:0:8552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707213.067394:0:8552:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787707213.067401:0:8552:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfa3f9b5800 00000020:00000080:0.0:1787707213.067404:0:8552:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787707213.070802:0:8552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8552:1874546729717120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787707213.070930:0:8552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707213.070991:0:8552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1fad8540 going to sleep for 11 seconds 00000100:00100000:2.0:1787707213.071701:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729717120 00000100:00100000:2.0:1787707213.071714:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729717120 00000100:00100000:2.0:1787707213.071966:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787707213.071978:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07315050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:8552:x1874546729717120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787707213.072298:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07315050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:8552:x1874546729717120:12345-0@lo:502:llog_process_th.0 Request processed in 321us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707213.072308:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787707213.072437:0:8552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8552:1874546729717120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787707213.072481:0:8552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787707213.072493:0:8552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707213.072495:0:8552:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787707213.072501:0:8552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787707213.075599:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787707213.075638:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787707213.075654:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0984 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec098b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707213.075670:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0984 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec098b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707213.075682:0:5853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787707213.075685:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfa34ab9800 from 4 10000000:01000000:0.0:1787707213.075689:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787707213.075921:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0992 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707213.075932:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0992 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707213.075948:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0992 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707213.075984:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729717248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787707213.076078:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707213.076131:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707213.076170:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729717248 00000100:00100000:0.0:1787707213.076180:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729717248 00000100:00100000:0.0:1787707213.076241:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787707213.076254:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07315850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729717248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787707213.076270:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707213.076287:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0999 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0992 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707213.076318:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0999 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0992 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707213.076332:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0999 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0992 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707213.076343:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2000, rc 0) 00000100:00100000:0.0:1787707213.076410:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07315850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729717248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707213.076418:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787707213.076475:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729717248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787707213.076492:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0992 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0999 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707213.076503:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0992 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0999 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707213.078152:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729717376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787707213.078223:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707213.081522:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707213.081596:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729717376 00000100:00100000:0.0:1787707213.081611:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729717376 00000100:00100000:0.0:1787707213.081698:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787707213.081710:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729717376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787707213.082285:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729717376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 575us (4059us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707213.082295:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787707213.082390:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729717376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787707213.082454:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729717504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787707213.082508:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707213.084189:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729717504 00000100:00100000:3.0:1787707213.084204:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729717504 00000100:00100000:3.0:1787707213.084280:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787707213.084292:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729717504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787707213.084412:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787707213.087182:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729717504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2879us (4661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707213.087202:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787707213.087354:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729717504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787707213.088869:0:8554:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8554:1874546729717632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787707213.088963:0:8554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707213.089029:0:8554:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f4be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787707213.089084:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729717632 00000100:00100000:0.0:1787707213.089094:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729717632 00000100:00100000:0.0:1787707213.089145:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787707213.089156:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:8554:x1874546729717632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787707213.089429:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:8554:x1874546729717632:12345-0@lo:502:llog_process_th.0 Request processed in 274us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707213.089437:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787707213.090160:0:8554:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8554:1874546729717632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787707213.090202:0:8554:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787707213.090215:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787707213.090218:0:8554:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787707213.090225:0:8554:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfa34ab9800 00000020:00000080:3.0:1787707213.090229:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787707213.090331:0:8554:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8554:1874546729717760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787707213.090400:0:8554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707213.090429:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729717760 00000100:00100000:3.0:1787707213.090434:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729717760 00000100:00100000:3.0:1787707213.090464:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787707213.090471:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:8554:x1874546729717760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787707213.093076:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:8554:x1874546729717760:12345-0@lo:502:llog_process_th.0 Request processed in 2591us (2662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707213.093096:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787707213.093267:0:8554:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f4be40 going to sleep for 11 seconds 00000100:00100000:3.0:1787707213.093303:0:8554:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8554:1874546729717760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787707213.093344:0:8554:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787707213.093354:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787707213.093357:0:8554:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787707213.093363:0:8554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787707213.094876:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787707213.094914:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787707213.094931:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0992 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0999 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707213.094945:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0992 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0999 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707213.094972:0:5853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787707213.094976:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfa02b55800 from 4 10000000:01000000:0.0:1787707213.094979:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787707213.095031:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec09a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707213.095040:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec09a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707213.095053:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec09a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707213.095084:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729717888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787707213.095168:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707213.095224:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f258900 going to sleep for 11 seconds 00000100:00100000:2.0:1787707213.099857:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729717888 00000100:00100000:2.0:1787707213.099879:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729717888 00000100:00100000:2.0:1787707213.099955:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787707213.100326:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729717888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787707213.100353:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707213.100418:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa08746600/0xc5f18d5f94ec09a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec09a0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707213.100457:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa08746600/0xc5f18d5f94ec09a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec09a0 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707213.100470:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa08746600/0xc5f18d5f94ec09a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec09a0 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707213.100483:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa08746600, rc 0) 00000100:00100000:2.0:1787707213.100595:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:5853:x1874546729717888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 629us (5428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707213.100602:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787707213.101915:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729717888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787707213.101946:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec09a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec09a7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707213.101960:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec09a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec09a7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707213.102060:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729718016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787707213.102124:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707213.102167:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f258900 going to sleep for 11 seconds 00000100:00100000:0.0:1787707213.102188:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729718016 00000100:00100000:0.0:1787707213.102193:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729718016 00000100:00100000:0.0:1787707213.102249:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787707213.102258:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:5853:x1874546729718016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787707213.102623:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:5853:x1874546729718016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 365us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707213.102631:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787707213.103877:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729718016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787707213.103947:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729718144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787707213.104462:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707213.104526:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787707213.105482:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729718144 00000100:00100000:2.0:1787707213.105495:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729718144 00000100:00100000:2.0:1787707213.106705:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787707213.106724:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:5853:x1874546729718144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787707213.107027:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:5853:x1874546729718144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 308us (2564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707213.107036:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787707213.110603:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729718144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787707213.130576:0:8559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8559:1874546729718272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787707213.130806:0:8559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707213.130869:0:8559:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f4b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787707213.130922:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729718272 00000100:00100000:2.0:1787707213.130932:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729718272 00000100:00100000:2.0:1787707213.130991:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787707213.131003:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:8559:x1874546729718272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787707213.131302:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:8559:x1874546729718272:12345-0@lo:502:llog_process_th.0 Request processed in 301us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707213.131312:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787707213.134576:0:8559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8559:1874546729718272:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787707213.134639:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787707213.134655:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707213.134658:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787707213.134668:0:8559:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfa02b55800 00000020:00000080:2.0:1787707213.134671:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787707213.134928:0:8559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8559:1874546729718400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787707213.135036:0:8559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707213.135093:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729718400 00000100:00100000:2.0:1787707213.135101:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729718400 00000100:00100000:2.0:1787707213.135161:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787707213.135173:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:8559:x1874546729718400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787707213.135475:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:8559:x1874546729718400:12345-0@lo:502:llog_process_th.0 Request processed in 304us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707213.135490:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787707213.135634:0:8559:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa08b9c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787707213.135651:0:8559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:8559:1874546729718400:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787707213.135678:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787707213.135685:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707213.135687:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787707213.135692:0:8559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787707213.135921:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787707213.135949:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787707213.135963:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec09a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec09a7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707213.135977:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec09a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec09a7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707213.258847:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707213.259010:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707666944 00000100:00100000:0.0:1787707213.259020:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707666944 00000100:00100000:0.0:1787707213.259080:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 187 00000100:00100000:0.0:1787707213.259090:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+9:5602:x1874546707666944:12345-192.168.204.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787707213.259108:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707213.259125:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa3fcd2600/0xc5f18d5f94ec09ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9bd9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707213.259168:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa3fcd2600/0xc5f18d5f94ec09ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9bd9 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707213.259180:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa3fcd2600/0xc5f18d5f94ec09ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9bd9 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707213.259189:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2600, rc 0) 00000100:00100000:0.0:1787707213.259249:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+10:5602:x1874546707666944:12345-192.168.204.46@tcp:101:ll_cfg_requeue.0 Request processed in 160us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707213.259257:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 187 00000100:00100000:1.0:1787707213.274015:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707213.274664:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707667072 00000100:00100000:3.0:1787707213.274675:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707667072 00000100:00100000:3.0:1787707213.274756:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 188 00000100:00100000:3.0:1787707213.274767:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+10:5602:x1874546707667072:12345-192.168.204.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787707213.275051:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+10:5602:x1874546707667072:12345-192.168.204.46@tcp:501:ll_cfg_requeue.0 Request processed in 285us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707213.275060:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 188 00000100:00100000:3.0:1787707213.280567:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707213.281545:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707667200 00000100:00100000:3.0:1787707213.281557:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707667200 00000100:00100000:3.0:1787707213.281616:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 189 00000100:00100000:3.0:1787707213.281627:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+10:5602:x1874546707667200:12345-192.168.204.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787707213.281869:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+10:5602:x1874546707667200:12345-192.168.204.46@tcp:503:ll_cfg_requeue.0 Request processed in 243us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707213.281879:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 189 00000100:00100000:2.0:1787707213.318270:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707213.320785:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707667328 00000100:00100000:1.0:1787707213.320799:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707667328 00000100:00100000:1.0:1787707213.320867:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 190 00000100:00100000:1.0:1787707213.320878:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+10:6158:x1874546707667328:12345-192.168.204.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787707213.321151:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+10:6158:x1874546707667328:12345-192.168.204.46@tcp:502:llog_process_th.0 Request processed in 273us (2888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707213.321159:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 190 00000100:00100000:3.0:1787707213.327872:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707213.327987:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707667456 00000100:00100000:2.0:1787707213.328001:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707667456 00000100:00100000:2.0:1787707213.328073:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 191 00000100:00100000:2.0:1787707213.328086:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+10:6158:x1874546707667456:12345-192.168.204.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787707213.328459:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+10:6158:x1874546707667456:12345-192.168.204.46@tcp:502:llog_process_th.0 Request processed in 374us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707213.328468:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 191 00010000:00010000:0.0:1787707214.072743:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707214.137191:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729718528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787707214.137264:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707214.137664:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729718528 00000100:00100000:1.0:1787707214.137674:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729718528 00000100:00100000:1.0:1787707214.137733:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787707214.137744:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729718528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787707214.137779:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787707214.137833:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729718528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707214.137841:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787707214.137881:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acb5c00 x1874546729718528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707214.137917:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729718528:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787707214.138034:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787707214.211481:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707214.211530:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707214.211582:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707214.211608:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707214.211636:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707667840 00000100:00100000:3.0:1787707214.211644:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707667840 00000100:00100000:3.0:1787707214.211699:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707667968 00000100:00100000:3.0:1787707214.211702:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707667968 00000100:00100000:3.0:1787707214.211723:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 20 00000100:00100000:3.0:1787707214.211733:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2360:x1874546707667840:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707214.211804:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2360:x1874546707667840:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 72us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707214.211820:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 20 00000100:00100000:3.0:1787707214.211837:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 21 00000100:00100000:3.0:1787707214.211845:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2360:x1874546707667968:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707214.211885:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2360:x1874546707667968:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 41us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707214.211891:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 21 00000100:00100000:3.0:1787707214.211951:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707667712 00000100:00100000:3.0:1787707214.211955:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707667712 00000100:00100000:3.0:1787707214.211986:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 37 00000100:00100000:3.0:1787707214.211993:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2360:x1874546707667712:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707214.212023:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2360:x1874546707667712:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 30us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707214.212036:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 37 00000100:00080000:3.0:1787707214.212056:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787707214.212060:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787707214.212062:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787707214.214699:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707667584 00000100:00100000:2.0:1787707214.214712:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707667584 00000100:00100000:2.0:1787707214.214773:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 192 00000100:00100000:2.0:1787707214.214784:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa18a93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+10:2360:x1874546707667584:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707214.214855:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa18a93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+10:2360:x1874546707667584:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 73us (3384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707214.214863:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 192 00010000:00010000:1.0:1787707215.097034:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707216.122181:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707216.185818:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729718656:0@lo:400:kworker.0 00000100:00100000:0.0:1787707216.185890:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707216.185983:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729718656 00000100:00100000:1.0:1787707216.185990:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729718656 00000100:00100000:1.0:1787707216.186045:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787707216.186054:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa18a93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729718656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707216.186525:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729719040:0@lo:400:kworker.0 00000100:00100000:2.0:1787707216.186559:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707216.186598:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729719040 00000100:00100000:2.0:1787707216.186602:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729719040 00000100:00100000:2.0:1787707216.186640:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787707216.186647:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729719040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707216.186683:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729719040:12345-0@lo:400:kworker.0 Request processed in 37us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707216.186691:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1787707216.186710:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787707216.186738:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa2f4a4000 x1874546729719040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707216.186752:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729719040:0@lo:400:kworker.0 00000100:00100000:1.0:1787707216.189334:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa18a93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729718656:12345-0@lo:400:kworker.0 Request processed in 3271us (3434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707216.189349:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787707216.189639:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787707216.189654:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729719168:0@lo:400:kworker.0 00000100:00100000:1.0:1787707216.189710:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707216.190731:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729718784:0@lo:400:kworker.0 00000100:00100000:1.0:1787707216.190779:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707216.190819:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729719296:0@lo:400:kworker.0 00000100:00100000:1.0:1787707216.190848:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707216.190869:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787707216.190876:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729718912:0@lo:400:kworker.0 00000100:00100000:1.0:1787707216.190896:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707216.190923:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729719168 00000100:00100000:2.0:1787707216.190931:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729719168 00000100:00100000:2.0:1787707216.190996:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729718784 00000100:00100000:2.0:1787707216.190999:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729718784 00000100:00100000:2.0:1787707216.191011:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729718912 00000100:00100000:2.0:1787707216.191013:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729718912 00000100:00100000:2.0:1787707216.191028:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787707216.191037:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729719168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707216.191090:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729719168:12345-0@lo:400:kworker.0 Request processed in 55us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707216.191097:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787707216.191111:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787707216.191116:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729718784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707216.191143:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729718784:12345-0@lo:400:kworker.0 Request processed in 27us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707216.191162:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787707216.191174:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787707216.191179:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729718912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707216.191220:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729718912:12345-0@lo:400:kworker.0 Request processed in 41us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707216.191226:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787707216.191262:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729718912:0@lo:400:kworker.0 00000100:00100000:2.0:1787707216.191272:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729718784:0@lo:400:kworker.0 00000100:00100000:2.0:1787707216.191297:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729719168:0@lo:400:kworker.0 00000100:00080000:1.0:1787707216.191413:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707216.191680:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729719296 00000100:00100000:3.0:1787707216.191684:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729719296 00000100:00100000:3.0:1787707216.191729:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787707216.191737:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729719296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707216.191783:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729719296:12345-0@lo:400:kworker.0 Request processed in 47us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707216.191789:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1787707216.191840:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787707216.192017:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa2f4a5180 x1874546729719296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707216.192029:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729719296:0@lo:400:kworker.0 00000100:00100000:0.0:1787707216.192680:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729718656:0@lo:400:kworker.0 00000100:00100000:3.0:1787707216.696725:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787707216.696749:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729719424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787707216.696830:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707216.696980:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729719424 00000100:00100000:0.0:1787707216.696988:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729719424 00000100:00100000:0.0:1787707216.697039:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787707216.697050:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729719424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787707216.697086:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707216.697141:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729719424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707216.697148:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787707216.697212:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa35b01880 x1874546729719424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707216.697229:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729719424:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787707217.144568:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707218.169209:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707219.193279:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707219.256678:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787707219.256739:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729719552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787707219.256818:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707219.256955:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729719552 00000100:00100000:1.0:1787707219.256970:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729719552 00000100:00100000:1.0:1787707219.257036:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787707219.257046:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729719552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787707219.257086:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787707219.257137:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729719552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707219.257145:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787707219.257216:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787707219.257252:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acb6300 x1874546729719552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707219.257271:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729719552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787707219.337943:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707219.337993:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707219.338452:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707668224 00000100:00100000:3.0:1787707219.338463:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707668224 00000100:00100000:3.0:1787707219.338537:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 41 00000100:00100000:3.0:1787707219.338548:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2360:x1874546707668224:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707219.338631:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2360:x1874546707668224:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 86us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707219.338638:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 41 00000100:00100000:0.0:1787707219.338959:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707668096 00000100:00100000:0.0:1787707219.338964:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707668096 00000100:00100000:0.0:1787707219.339006:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 194 00000100:00100000:0.0:1787707219.339014:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa18a91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+10:2360:x1874546707668096:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707219.339049:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa18a91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+10:2360:x1874546707668096:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 36us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707219.339055:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 194 00000100:00080000:0.0:1787707219.339115:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707219.348958:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707219.349006:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707219.349035:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707668352 00000100:00100000:0.0:1787707219.349045:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707668352 00000100:00100000:0.0:1787707219.349102:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707668480 00000100:00100000:0.0:1787707219.349106:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707668480 00000100:00100000:0.0:1787707219.349132:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 10 00000100:00100000:0.0:1787707219.349143:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2358:x1874546707668352:12345-192.168.204.46@tcp:9:kworker.0 00000020:00000080:0.0:1787707219.349177:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec08ea 00000100:00080000:0.0:1787707219.349186:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8cf9012d5000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787707219.349225:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787707219.350922:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+2:2358:x1874546707668352:12345-192.168.204.46@tcp:9:kworker.0 Request processed in 1773us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707219.350934:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 10 00000100:00100000:0.0:1787707219.350964:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 11 00000100:00100000:0.0:1787707219.350974:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2358:x1874546707668480:12345-192.168.204.46@tcp:9:kworker.0 00000020:00000080:0.0:1787707219.351069:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec08f1 00000100:00080000:0.0:1787707219.351079:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8cf9012d3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787707219.351121:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787707219.351411:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+2:2358:x1874546707668480:12345-192.168.204.46@tcp:9:kworker.0 Request processed in 438us (2403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707219.351418:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 11 00010000:00010000:0.0:1787707219.351505:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787707219.365185:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787707219.365197:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787707219.366114:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707220.217529:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787707220.308107:0:8809:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg446-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1787707221.240722:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707221.309416:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729720064:0@lo:400:kworker.0 00000100:00100000:2.0:1787707221.309492:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707221.309550:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787707221.309556:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729719680:0@lo:400:kworker.0 00000100:00100000:2.0:1787707221.309585:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707221.309622:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729720192:0@lo:400:kworker.0 00000100:00100000:2.0:1787707221.309648:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707221.309680:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729720064 00000100:00100000:2.0:1787707221.309687:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729720064 00000100:00100000:2.0:1787707221.309741:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787707221.309751:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729720064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707221.309808:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729720064:12345-0@lo:400:kworker.0 Request processed in 59us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707221.309817:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787707221.309840:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729719680 00000100:00100000:2.0:1787707221.309844:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729719680 00000100:00100000:2.0:1787707221.309870:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787707221.309876:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729719680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707221.309907:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729719680:12345-0@lo:400:kworker.0 Request processed in 32us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707221.309912:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787707221.309938:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729720192 00000100:00100000:2.0:1787707221.309942:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729720192 00000100:00100000:2.0:1787707221.309970:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787707221.309977:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729720192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707221.310007:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729720192:12345-0@lo:400:kworker.0 Request processed in 30us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707221.310013:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787707221.310049:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729719680:0@lo:400:kworker.0 00000100:00100000:2.0:1787707221.310061:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729720192:0@lo:400:kworker.0 00010000:00080000:2.0:1787707221.310072:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acb6300 x1874546729720064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707221.310082:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729720064:0@lo:400:kworker.0 00000100:00100000:2.0:1787707221.310138:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729719808:0@lo:400:kworker.0 00000100:00100000:2.0:1787707221.310163:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707221.310190:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729720320:0@lo:400:kworker.0 00000100:00100000:2.0:1787707221.310226:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707221.310243:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787707221.310248:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729719936:0@lo:400:kworker.0 00000100:00100000:2.0:1787707221.310796:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707221.310831:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729719808 00000100:00100000:2.0:1787707221.310836:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729719808 00000100:00100000:2.0:1787707221.310860:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729719936 00000100:00100000:2.0:1787707221.310863:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729719936 00000100:00100000:2.0:1787707221.310881:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787707221.310887:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729719808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707221.310923:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729719808:12345-0@lo:400:kworker.0 Request processed in 36us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707221.310929:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787707221.310942:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787707221.310948:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729719936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707221.310972:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729719936:12345-0@lo:400:kworker.0 Request processed in 25us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707221.310977:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787707221.310993:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729720320 00000100:00100000:2.0:1787707221.310996:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729720320 00000100:00100000:2.0:1787707221.311020:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787707221.311026:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729720320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707221.311054:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729720320:12345-0@lo:400:kworker.0 Request processed in 29us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707221.311060:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787707221.311091:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729719936:0@lo:400:kworker.0 00000100:00100000:2.0:1787707221.311111:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729719808:0@lo:400:kworker.0 00010000:00080000:2.0:1787707221.311121:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41fd1500 x1874546729720320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707221.311131:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729720320:0@lo:400:kworker.0 00000100:00080000:1.0:1787707221.312662:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787707221.312671:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787707221.312674:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787707221.819559:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729720448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787707221.819629:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707221.821111:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729720448 00000100:00100000:2.0:1787707221.821122:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729720448 00000100:00100000:2.0:1787707221.821175:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787707221.821185:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729720448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787707221.821221:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707221.821291:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729720448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707221.821298:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787707221.821431:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acb6300 x1874546729720448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707221.821449:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729720448:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787707222.270542:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787707222.995658:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9ed4058d-c366-401f-b84d-540fc0489f0c 00000020:00000080:2.0:1787707222.995667:0:6712:0:(genops.c:885:class_export_put()) final put ffff8cf9012d0000/9ed4058d-c366-401f-b84d-540fc0489f0c 00000020:00000080:2.0:1787707222.995693:0:1375:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf9012d0000/9ed4058d-c366-401f-b84d-540fc0489f0c for lustre-OST0000 00000020:00000080:2.0:1787707222.995735:0:1375:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cf9012d5000 for lustre-OST0000 00010000:00010000:1.0:1787707223.288950:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787707223.976053:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9ed4058d-c366-401f-b84d-540fc0489f0c 00000020:00000080:0.0:1787707223.976064:0:7642:0:(genops.c:885:class_export_put()) final put ffff8cf9012d3000/9ed4058d-c366-401f-b84d-540fc0489f0c 00000020:00000080:0.0:1787707223.976091:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf9012d3000/9ed4058d-c366-401f-b84d-540fc0489f0c for lustre-OST0001 00000020:00000080:0.0:1787707223.976140:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cf9012d3800 for lustre-OST0001 00010000:00010000:0.0:1787707224.314040:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707224.386125:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787707224.386149:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729720576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787707224.386218:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707224.386323:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729720576 00000100:00100000:2.0:1787707224.386332:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729720576 00000100:00100000:3.0:1787707224.386819:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787707224.386833:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729720576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787707224.386881:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707224.386934:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729720576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707224.386942:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787707224.391934:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787707224.393084:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acb6300 x1874546729720576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707224.393111:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729720576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787707224.452070:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707224.452528:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707224.452557:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707668608 00000100:00100000:3.0:1787707224.452566:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707668608 00000100:00100000:3.0:1787707224.452618:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 196 00000100:00100000:3.0:1787707224.452629:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+10:2360:x1874546707668608:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707224.452714:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+10:2360:x1874546707668608:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 87us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707224.452722:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 196 00000100:00100000:2.0:1787707224.452993:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707668736 00000100:00100000:2.0:1787707224.452998:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707668736 00000100:00100000:2.0:1787707224.453054:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 45 00000100:00100000:2.0:1787707224.453062:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2359:x1874546707668736:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707224.453100:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2359:x1874546707668736:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 39us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707224.453106:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 45 00000100:00080000:3.0:1787707224.455279:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787707225.338693:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707226.360524:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707226.429793:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729721088:0@lo:400:kworker.0 00000100:00100000:3.0:1787707226.429863:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707226.429922:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787707226.429928:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729720704:0@lo:400:kworker.0 00000100:00100000:3.0:1787707226.429959:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707226.429982:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729721216:0@lo:400:kworker.0 00000100:00100000:3.0:1787707226.430003:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707226.430028:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729720832:0@lo:400:kworker.0 00000100:00100000:3.0:1787707226.430049:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707226.430064:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729721344:0@lo:400:kworker.0 00000100:00100000:3.0:1787707226.430081:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707226.430097:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787707226.430102:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729720960:0@lo:400:kworker.0 00000100:00100000:3.0:1787707226.430121:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707226.430307:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729721088 00000100:00100000:3.0:1787707226.430315:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729721088 00000100:00100000:3.0:1787707226.431494:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729721344 00000100:00100000:3.0:1787707226.431504:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729721344 00000100:00080000:1.0:1787707226.431981:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787707226.431986:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787707226.432576:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787707226.432592:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729721088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707226.432694:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729721088:12345-0@lo:400:kworker.0 Request processed in 108us (2830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707226.432702:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787707226.432730:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729721216 00000100:00100000:2.0:1787707226.432736:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729721216 00000100:00100000:2.0:1787707226.432778:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729720832 00000100:00100000:2.0:1787707226.432782:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729720832 00000100:00100000:2.0:1787707226.432794:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729720960 00000100:00100000:2.0:1787707226.432797:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729720960 00000100:00100000:2.0:1787707226.432811:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787707226.432817:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729721216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707226.432849:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729721216:12345-0@lo:400:kworker.0 Request processed in 32us (2844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707226.432855:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787707226.432867:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787707226.432873:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729720832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707226.432907:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729720832:12345-0@lo:400:kworker.0 Request processed in 34us (2856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707226.432913:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787707226.432925:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787707226.432931:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729720960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707226.432956:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729720960:12345-0@lo:400:kworker.0 Request processed in 26us (2835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707226.432961:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787707226.432984:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729720704 00000100:00100000:2.0:1787707226.432999:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729720704 00000100:00100000:2.0:1787707226.433025:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787707226.433030:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729720704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707226.433058:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729720704:12345-0@lo:400:kworker.0 Request processed in 28us (3098us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707226.433064:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:2.0:1787707226.433091:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787707226.433177:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729720704:0@lo:400:kworker.0 00000100:00100000:1.0:1787707226.433192:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729721216:0@lo:400:kworker.0 00010000:00080000:1.0:1787707226.433205:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa2f4a5500 x1874546729721088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707226.433215:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729721088:0@lo:400:kworker.0 00000100:00100000:3.0:1787707226.438825:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787707226.438846:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729721344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707226.438936:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729721344:12345-0@lo:400:kworker.0 Request processed in 99us (8853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707226.438953:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787707226.439009:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729720960:0@lo:400:kworker.0 00000100:00100000:3.0:1787707226.439022:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729720832:0@lo:400:kworker.0 00010000:00080000:3.0:1787707226.439035:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa2f4a6680 x1874546729721344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707226.439044:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729721344:0@lo:400:kworker.0 00000100:00100000:3.0:1787707226.940991:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729721472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787707226.941070:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707226.941255:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729721472 00000100:00100000:2.0:1787707226.941263:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729721472 00000100:00100000:2.0:1787707226.941314:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787707226.941324:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729721472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787707226.941361:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707226.941436:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729721472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707226.941444:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787707226.941528:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acb6300 x1874546729721472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707226.941547:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729721472:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787707227.310116:0:9058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg446-server.virtnet: executing yml_node 00010000:00010000:0.0:1787707227.388876:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707228.409313:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707229.432627:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707229.503707:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787707229.503747:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729721600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787707229.503828:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707229.504195:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729721600 00000100:00100000:2.0:1787707229.504216:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729721600 00000100:00100000:2.0:1787707229.504285:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787707229.504296:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729721600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787707229.504332:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707229.504405:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729721600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707229.504412:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1787707229.504461:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3acb6300 x1874546729721600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707229.504479:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729721600:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787707229.506785:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787707229.578641:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707229.578741:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707229.582210:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707668864 00000100:00100000:3.0:1787707229.582225:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707668864 00000100:00100000:3.0:1787707229.582290:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 198 00000100:00100000:3.0:1787707229.582301:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+10:2359:x1874546707668864:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707229.582394:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+10:2359:x1874546707668864:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 94us (3659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707229.582401:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 198 00000100:00100000:2.0:1787707229.587664:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707668992 00000100:00100000:2.0:1787707229.587690:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707668992 00000100:00080000:2.0:1787707229.587729:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787707229.588179:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 49 00000100:00100000:2.0:1787707229.588191:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2359:x1874546707668992:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707229.588286:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2359:x1874546707668992:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 96us (9652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707229.588294:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 49 00010000:00010000:0.0:1787707230.458462:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707231.486044:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707231.545618:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729721984:0@lo:400:kworker.0 00000100:00100000:1.0:1787707231.545701:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707231.545764:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787707231.545771:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729721856:0@lo:400:kworker.0 00000100:00100000:1.0:1787707231.545812:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707231.545956:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729721984 00000100:00100000:0.0:1787707231.545966:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729721984 00000100:00100000:0.0:1787707231.546021:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729721856 00000100:00100000:0.0:1787707231.546024:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729721856 00000100:00100000:0.0:1787707231.546045:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787707231.546054:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729721984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707231.546105:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729721984:12345-0@lo:400:kworker.0 Request processed in 51us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707231.546113:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787707231.546139:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787707231.546145:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729721856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707231.546188:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729721856:12345-0@lo:400:kworker.0 Request processed in 43us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707231.546193:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1787707231.546211:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787707231.546339:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729721728:0@lo:400:kworker.0 00000100:00100000:2.0:1787707231.546403:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707231.546428:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729722240:0@lo:400:kworker.0 00000100:00100000:2.0:1787707231.546452:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707231.546467:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787707231.546473:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729722112:0@lo:400:kworker.0 00000100:00100000:2.0:1787707231.546497:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707231.546522:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729722240 00000100:00100000:2.0:1787707231.546526:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729722240 00000100:00100000:2.0:1787707231.546556:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787707231.546562:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729722240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707231.546596:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729722240:12345-0@lo:400:kworker.0 Request processed in 34us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707231.546602:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787707231.546620:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729722112 00000100:00100000:2.0:1787707231.546623:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729722112 00000100:00100000:2.0:1787707231.546649:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787707231.546656:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729722112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707231.546687:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729722112:12345-0@lo:400:kworker.0 Request processed in 32us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707231.546699:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1787707231.546731:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41fd3100 x1874546729722112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707231.546745:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729722112:0@lo:400:kworker.0 00000100:00100000:2.0:1787707231.546756:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729722240:0@lo:400:kworker.0 00000100:00100000:0.0:1787707231.546982:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729721728 00000100:00100000:0.0:1787707231.546986:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729721728 00000100:00100000:0.0:1787707231.547022:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787707231.547029:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729721728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707231.547067:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729721728:12345-0@lo:400:kworker.0 Request processed in 38us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707231.547073:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:0.0:1787707231.547100:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787707231.547104:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707231.547118:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729721728:0@lo:400:kworker.0 00000100:00100000:1.0:1787707231.547382:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729721856:0@lo:400:kworker.0 00000100:00100000:1.0:1787707231.547391:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729722368:0@lo:400:kworker.0 00000100:00100000:1.0:1787707231.547417:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707231.547442:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729721984:0@lo:400:kworker.0 00000100:00100000:0.0:1787707231.547570:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729722368 00000100:00100000:0.0:1787707231.547575:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729722368 00000100:00100000:0.0:1787707231.547618:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787707231.547624:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729722368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707231.547666:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729722368:12345-0@lo:400:kworker.0 Request processed in 42us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707231.547671:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787707231.547736:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41fd0000 x1874546729722368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707231.547747:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729722368:0@lo:400:kworker.0 00000100:00080000:2.0:1787707231.548354:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787707232.056738:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787707232.056764:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729722496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787707232.056836:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707232.057024:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729722496 00000100:00100000:2.0:1787707232.057033:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729722496 00000100:00100000:2.0:1787707232.057091:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787707232.057102:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729722496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787707232.057188:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707232.057421:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729722496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 320us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707232.057429:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787707232.059053:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa06ecf800 x1874546729722496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707232.059085:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729722496:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787707232.507021:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707233.529635:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707234.555220:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707234.617255:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787707234.617312:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729722624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787707234.617426:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707234.618742:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729722624 00000100:00100000:2.0:1787707234.618754:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729722624 00000100:00100000:2.0:1787707234.618841:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787707234.618852:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729722624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787707234.618887:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707234.618955:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729722624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707234.618962:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787707234.619030:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa06ece300 x1874546729722624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707234.619050:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729722624:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787707234.619232:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787707234.704335:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707234.704430:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707669120 00000100:00100000:2.0:1787707234.704442:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707669120 00000100:00100000:2.0:1787707234.704517:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 200 00000100:00100000:2.0:1787707234.704529:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+10:2360:x1874546707669120:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707234.704605:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+10:2360:x1874546707669120:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 79us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707234.704613:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 200 00000001:02000400:3.0:1787707234.716512:0:9250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.80 00000100:00100000:1.0:1787707234.729366:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707234.729431:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707669248 00000100:00100000:1.0:1787707234.729441:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707669248 00000100:00080000:3.0:1787707234.729489:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707234.729557:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 53 00000100:00100000:3.0:1787707234.729571:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2360:x1874546707669248:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707234.729656:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2360:x1874546707669248:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 89us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707234.729664:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 53 00010000:00010000:0.0:1787707235.587313:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707236.602602:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707236.664607:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729722880:0@lo:400:kworker.0 00000100:00100000:1.0:1787707236.664729:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707236.664781:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729723392:0@lo:400:kworker.0 00000100:00100000:1.0:1787707236.664805:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707236.664833:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787707236.664838:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729723008:0@lo:400:kworker.0 00000100:00100000:1.0:1787707236.664857:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707236.664890:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729722880 00000100:00100000:1.0:1787707236.664897:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729722880 00000100:00100000:1.0:1787707236.664937:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729723008 00000100:00100000:1.0:1787707236.664940:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729723008 00000100:00100000:1.0:1787707236.664967:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787707236.664975:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729722880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707236.665024:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729722880:12345-0@lo:400:kworker.0 Request processed in 50us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707236.665044:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787707236.665183:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729723136:0@lo:400:kworker.0 00000100:00100000:3.0:1787707236.665242:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707236.665264:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787707236.665270:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729722752:0@lo:400:kworker.0 00000100:00100000:3.0:1787707236.665298:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707236.665318:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729723264:0@lo:400:kworker.0 00000100:00100000:3.0:1787707236.665339:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707236.665359:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729723392 00000100:00100000:3.0:1787707236.665363:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729723392 00000100:00100000:3.0:1787707236.665423:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729723136 00000100:00100000:3.0:1787707236.665427:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729723136 00000100:00100000:3.0:1787707236.665448:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787707236.665455:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729723392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707236.665486:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729723392:12345-0@lo:400:kworker.0 Request processed in 32us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707236.665492:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787707236.665504:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787707236.665510:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729723136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707236.665539:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729723136:12345-0@lo:400:kworker.0 Request processed in 30us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707236.665544:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787707236.665560:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729722752 00000100:00100000:3.0:1787707236.665563:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729722752 00000100:00100000:3.0:1787707236.665597:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787707236.665604:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729722752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707236.665634:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729722752:12345-0@lo:400:kworker.0 Request processed in 30us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707236.665639:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787707236.665696:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729722752:0@lo:400:kworker.0 00010000:00080000:3.0:1787707236.665709:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41fd0700 x1874546729723136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707236.665720:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729723136:0@lo:400:kworker.0 00000100:00100000:3.0:1787707236.665761:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729723264 00000100:00100000:3.0:1787707236.665765:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729723264 00000100:00100000:1.0:1787707236.666791:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787707236.666813:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729723008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707236.666872:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729723008:12345-0@lo:400:kworker.0 Request processed in 69us (2013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707236.668004:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787707236.668021:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729723264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707236.668097:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729723264:12345-0@lo:400:kworker.0 Request processed in 85us (2757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707236.668104:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787707236.668161:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729723264:0@lo:400:kworker.0 00000100:00080000:3.0:1787707236.668206:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787707236.668212:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787707236.668215:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707236.668251:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729723008:0@lo:400:kworker.0 00000100:00100000:3.0:1787707236.668263:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729722880:0@lo:400:kworker.0 00010000:00080000:3.0:1787707236.668278:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41fd0000 x1874546729723392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707236.668420:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729723392:0@lo:400:kworker.0 00000100:00100000:1.0:1787707236.675806:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787707237.184313:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729723520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787707237.184415:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707237.184487:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729723520 00000100:00100000:0.0:1787707237.184495:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729723520 00000100:00100000:0.0:1787707237.184542:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787707237.184552:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729723520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787707237.184589:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707237.184635:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729723520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707237.184642:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787707237.184681:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa35b01500 x1874546729723520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707237.184697:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729723520:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787707237.631873:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787707237.899488:0:9347:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.80 00010000:00010000:0.0:1787707238.659186:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707239.675220:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707239.737196:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787707239.737220:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729723648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787707239.737301:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707239.737715:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729723648 00000100:00100000:2.0:1787707239.737723:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729723648 00000100:00100000:2.0:1787707239.737790:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787707239.737801:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729723648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787707239.737838:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787707239.738051:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787707239.740077:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729723648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2269us (2767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707239.740099:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1787707239.740442:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa06ece300 x1874546729723648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707239.740463:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729723648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787707239.817014:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707239.826363:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707239.838928:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707669376 00000100:00100000:2.0:1787707239.838946:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707669376 00000100:00100000:2.0:1787707239.839030:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 202 00000100:00100000:2.0:1787707239.839042:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+10:2359:x1874546707669376:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707239.839145:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+10:2359:x1874546707669376:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 105us (12817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707239.839153:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 202 00000100:00100000:1.0:1787707239.840498:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707669504 00000100:00100000:1.0:1787707239.840509:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707669504 00000100:00100000:1.0:1787707239.840692:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 57 00000100:00100000:1.0:1787707239.840701:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2359:x1874546707669504:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707239.840783:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2359:x1874546707669504:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 84us (23791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707239.840791:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 57 00000100:00080000:3.0:1787707239.844167:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787707240.638981:0:9445:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.80 00010000:00010000:0.0:1787707240.708876:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707241.723218:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707241.784817:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729724032:0@lo:400:kworker.0 00000100:00100000:0.0:1787707241.784891:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707241.784975:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787707241.784981:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729723904:0@lo:400:kworker.0 00000100:00100000:0.0:1787707241.785007:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707241.785034:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729724416:0@lo:400:kworker.0 00000100:00100000:0.0:1787707241.785058:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707241.785725:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729724160:0@lo:400:kworker.0 00000100:00100000:1.0:1787707241.785762:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707241.785791:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787707241.785797:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729723776:0@lo:400:kworker.0 00000100:00100000:1.0:1787707241.785822:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707241.785844:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729724288:0@lo:400:kworker.0 00000100:00100000:1.0:1787707241.785863:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707241.785889:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729724032 00000100:00100000:1.0:1787707241.785896:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729724032 00000100:00100000:1.0:1787707241.785942:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729723904 00000100:00100000:1.0:1787707241.785945:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729723904 00000100:00100000:1.0:1787707241.785959:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729724288 00000100:00100000:1.0:1787707241.785983:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729724288 00000100:00100000:1.0:1787707241.786006:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787707241.786014:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729724032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707241.786077:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729724032:12345-0@lo:400:kworker.0 Request processed in 64us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707241.786094:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787707241.786111:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787707241.786410:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729724416 00000100:00100000:0.0:1787707241.786414:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729724416 00000100:00100000:0.0:1787707241.786440:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729724160 00000100:00100000:0.0:1787707241.786442:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729724160 00000100:00100000:0.0:1787707241.786459:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787707241.786465:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729724416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707241.786511:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729724416:12345-0@lo:400:kworker.0 Request processed in 34us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707241.786517:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787707241.786529:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787707241.786534:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729724160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707241.786564:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729724160:12345-0@lo:400:kworker.0 Request processed in 30us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707241.786570:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787707241.786602:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787707241.786609:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729724288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707241.786635:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729724288:12345-0@lo:400:kworker.0 Request processed in 27us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707241.786651:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787707241.786673:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729723776 00000100:00100000:0.0:1787707241.786676:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729723776 00000100:00100000:0.0:1787707241.786696:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787707241.787769:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729723904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707241.787829:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729723904:12345-0@lo:400:kworker.0 Request processed in 1711us (2820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707241.787838:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787707241.787890:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729724288:0@lo:400:kworker.0 00010000:00080000:1.0:1787707241.787904:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa35b00e00 x1874546729724160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707241.787915:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729724160:0@lo:400:kworker.0 00000100:00100000:1.0:1787707241.787948:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729723904:0@lo:400:kworker.0 00010000:00080000:1.0:1787707241.787959:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa35b01180 x1874546729724416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707241.787983:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729724416:0@lo:400:kworker.0 00000100:00100000:1.0:1787707241.787995:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729724032:0@lo:400:kworker.0 00000100:00100000:0.0:1787707241.788116:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729723776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707241.788152:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729723776:12345-0@lo:400:kworker.0 Request processed in 41us (2329us total) trans 0 rc 0/0 00000100:00080000:3.0:1787707241.788655:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787707241.788661:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787707241.788664:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787707241.789150:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729723776:0@lo:400:kworker.0 00000100:00100000:0.0:1787707241.806880:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787707242.296921:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729724544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787707242.297021:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707242.297180:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729724544 00000100:00100000:3.0:1787707242.297188:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729724544 00000100:00100000:3.0:1787707242.297250:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787707242.297262:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729724544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787707242.297306:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707242.297366:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729724544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707242.297393:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787707242.297527:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa35b00a80 x1874546729724544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707242.297545:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729724544:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787707242.749743:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787707243.706764:0:9493:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Aug 25 21:20:40 EDT 2026 00010000:00010000:3.0:1787707243.784015:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707244.793169:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707244.856961:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787707244.856986:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729724672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787707244.857055:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707244.857712:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729724672 00000100:00100000:2.0:1787707244.857721:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729724672 00000100:00100000:2.0:1787707244.857798:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787707244.857816:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729724672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787707244.857853:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707244.857925:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729724672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707244.857933:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1787707244.858019:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa06ece300 x1874546729724672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707244.858037:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729724672:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787707244.858335:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787707244.930751:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707244.930849:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707244.932146:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707669760 00000100:00100000:1.0:1787707244.932160:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707669760 00000100:00100000:1.0:1787707244.932253:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 61 00000100:00100000:1.0:1787707244.932264:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2360:x1874546707669760:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707244.932366:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2360:x1874546707669760:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 103us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707244.932401:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 61 00000100:00080000:2.0:1787707244.934055:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707244.941900:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707669632 00000100:00100000:3.0:1787707244.941938:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707669632 00000100:00100000:3.0:1787707244.942012:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 204 00000100:00100000:3.0:1787707244.942023:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+10:2360:x1874546707669632:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707244.942117:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+10:2360:x1874546707669632:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 96us (11386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707244.942126:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 204 00010000:00010000:1.0:1787707245.819451:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707246.845330:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707246.905580:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729725056:0@lo:400:kworker.0 00000100:00100000:3.0:1787707246.905628:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729724800:0@lo:400:kworker.0 00000100:00100000:1.0:1787707246.905756:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729725184:0@lo:400:kworker.0 00000100:00100000:2.0:1787707246.905823:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729724928:0@lo:400:kworker.0 00000100:00100000:0.0:1787707246.905880:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707246.906654:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707246.906754:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729725312:0@lo:400:kworker.0 00000100:00100000:3.0:1787707246.906793:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707246.906843:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729725056 00000100:00100000:3.0:1787707246.906850:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729725056 00000100:00100000:3.0:1787707246.906932:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729725312 00000100:00100000:3.0:1787707246.906937:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729725312 00000100:00100000:3.0:1787707246.906964:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787707246.906972:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729725056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707246.907026:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729725056:12345-0@lo:400:kworker.0 Request processed in 54us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707246.907033:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787707246.907049:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787707246.907055:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729725312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707246.907086:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729725312:12345-0@lo:400:kworker.0 Request processed in 32us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707246.907092:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1787707246.907108:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707246.907164:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729725056:0@lo:400:kworker.0 00000100:00100000:3.0:1787707246.907194:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729725312:0@lo:400:kworker.0 00000100:00100000:0.0:1787707246.907304:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729724800 00000100:00100000:0.0:1787707246.907308:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729724800 00000100:00100000:0.0:1787707246.907484:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787707246.907493:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729724800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707246.907532:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729724800:12345-0@lo:400:kworker.0 Request processed in 41us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707246.907538:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787707246.907647:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729724800:0@lo:400:kworker.0 00000100:00100000:2.0:1787707246.911482:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707246.911554:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729725440:0@lo:400:kworker.0 00000100:00100000:0.0:1787707246.911575:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707246.911602:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729724928 00000100:00100000:3.0:1787707246.911623:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729724928 00000100:00100000:3.0:1787707246.911677:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787707246.911689:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729724928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707246.911733:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729725184 00000100:00100000:1.0:1787707246.911742:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729725184 00000100:00100000:3.0:1787707246.911774:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729724928:12345-0@lo:400:kworker.0 Request processed in 84us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707246.911786:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1787707246.911818:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787707246.911863:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707246.911948:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729724928:0@lo:400:kworker.0 00000100:00100000:3.0:1787707246.911987:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729725440 00000100:00100000:3.0:1787707246.911994:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729725440 00000100:00100000:3.0:1787707246.912044:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787707246.912054:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729725440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707246.912093:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787707246.912110:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729725184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707246.912120:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729725440:12345-0@lo:400:kworker.0 Request processed in 63us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707246.912130:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787707246.912175:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa35b00380 x1874546729725440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707246.912191:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729725440:0@lo:400:kworker.0 00000100:00080000:1.0:1787707246.912264:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787707246.912522:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729725184:12345-0@lo:400:kworker.0 Request processed in 417us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707246.912532:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1787707246.916772:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa35b00700 x1874546729725184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707246.916797:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729725184:0@lo:400:kworker.0 00000100:00100000:1.0:1787707247.418546:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787707247.418575:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729725568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787707247.418677:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707247.418960:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729725568 00000100:00100000:3.0:1787707247.418971:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729725568 00000100:00100000:3.0:1787707247.419043:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787707247.419054:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729725568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787707247.419101:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707247.419713:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729725568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 658us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707247.419722:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787707247.420069:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41fd0e00 x1874546729725568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707247.420096:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729725568:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787707247.869467:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707248.889655:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707249.913483:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707249.977071:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787707249.990055:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729725696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787707249.990282:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707249.990602:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729725696 00000100:00100000:0.0:1787707249.990614:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729725696 00000100:00080000:3.0:1787707249.990769:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787707249.990819:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787707249.990832:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729725696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787707249.990881:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707249.990961:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729725696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707249.990969:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1787707249.991358:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41ca3100 x1874546729725696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707249.991415:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729725696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787707250.053492:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707250.053569:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707250.053701:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707670016 00000100:00100000:3.0:1787707250.053716:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707670016 00000100:00100000:3.0:1787707250.053818:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 65 00000100:00100000:3.0:1787707250.053832:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2362:x1874546707670016:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707250.053933:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2362:x1874546707670016:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 104us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707250.053941:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 65 00000100:00100000:1.0:1787707250.055112:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707669888 00000100:00100000:1.0:1787707250.055142:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707669888 00000100:00100000:1.0:1787707250.055213:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 206 00000100:00100000:1.0:1787707250.055222:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+10:2362:x1874546707669888:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707250.055288:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+10:2362:x1874546707669888:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 68us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707250.055295:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 206 00000100:00080000:0.0:1787707250.055487:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787707250.941268:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707251.960554:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707252.024751:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa07332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729726208:0@lo:400:kworker.0 00000100:00100000:0.0:1787707252.024834:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707252.024932:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa07331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729725824:0@lo:400:kworker.0 00000100:00100000:0.0:1787707252.024934:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729725952:0@lo:400:kworker.0 00000100:00100000:0.0:1787707252.024995:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707252.026358:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa07331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729726464:0@lo:400:kworker.0 00000100:00100000:0.0:1787707252.026426:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707252.026475:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787707252.026483:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa07330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729726080:0@lo:400:kworker.0 00000100:00100000:0.0:1787707252.026521:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707252.026558:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729726208 00000100:00100000:0.0:1787707252.026565:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729726208 00000100:00100000:0.0:1787707252.026616:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729726464 00000100:00100000:0.0:1787707252.026620:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729726464 00000100:00100000:0.0:1787707252.026646:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787707252.026656:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729726208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707252.026710:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729726208:12345-0@lo:400:kworker.0 Request processed in 55us (1876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707252.026717:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787707252.026734:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787707252.026741:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729726464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707252.026785:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729726464:12345-0@lo:400:kworker.0 Request processed in 45us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707252.026791:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787707252.026810:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729725952 00000100:00100000:0.0:1787707252.026813:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729725952 00000100:00100000:0.0:1787707252.026836:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729726080 00000100:00100000:0.0:1787707252.026839:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729726080 00000100:00100000:0.0:1787707252.026858:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787707252.026865:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729725952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707252.026893:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729725952:12345-0@lo:400:kworker.0 Request processed in 30us (1900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707252.026899:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787707252.026909:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787707252.026914:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729726080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707252.026938:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729726080:12345-0@lo:400:kworker.0 Request processed in 24us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707252.026950:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1787707252.026965:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787707252.026970:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787707252.026971:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787707252.027032:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa07332a00 x1874546729726208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707252.027045:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa07332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729726208:0@lo:400:kworker.0 00000100:00100000:0.0:1787707252.027145:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa07330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729726080:0@lo:400:kworker.0 00000100:00100000:0.0:1787707252.027155:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729725952:0@lo:400:kworker.0 00010000:00080000:0.0:1787707252.027164:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa07331f80 x1874546729726464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707252.027172:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa07331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729726464:0@lo:400:kworker.0 00000100:00100000:3.0:1787707252.037292:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707252.037406:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa07330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729726336:0@lo:400:kworker.0 00000100:00100000:3.0:1787707252.037494:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707252.037573:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729726336 00000100:00100000:1.0:1787707252.037589:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729726336 00000100:00100000:0.0:1787707252.037683:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729725824 00000100:00100000:1.0:1787707252.037692:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787707252.037694:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729725824 00000100:00100000:1.0:1787707252.037707:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729726336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707252.037756:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787707252.037780:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729725824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707252.037866:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729725824:12345-0@lo:400:kworker.0 Request processed in 97us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707252.037875:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787707252.037891:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729726336:12345-0@lo:400:kworker.0 Request processed in 187us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707252.037903:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1787707252.038271:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707252.038309:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa07331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729725824:0@lo:400:kworker.0 00000100:00100000:3.0:1787707252.038325:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa07330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729726336:0@lo:400:kworker.0 00000100:00100000:1.0:1787707252.536822:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787707252.536846:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729726592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787707252.536916:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707252.536990:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729726592 00000100:00100000:1.0:1787707252.537014:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729726592 00000100:00100000:1.0:1787707252.537062:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787707252.537071:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729726592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787707252.537106:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787707252.537151:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729726592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707252.537158:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787707252.537200:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41fd0e00 x1874546729726592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707252.537232:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729726592:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787707252.984549:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707254.017892:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707255.033335:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707255.104837:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787707255.104875:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729726720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787707255.105130:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707255.105359:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729726720 00000100:00100000:2.0:1787707255.105398:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729726720 00000100:00100000:2.0:1787707255.105478:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787707255.105491:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729726720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787707255.105541:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707255.105612:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729726720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707255.105620:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1787707255.105648:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787707255.105689:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41ca0000 x1874546729726720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707255.107473:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729726720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787707255.172359:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707255.172891:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707255.172945:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707670144 00000100:00100000:0.0:1787707255.172957:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707670144 00000100:00100000:0.0:1787707255.173019:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 208 00000100:00100000:0.0:1787707255.173031:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+10:2362:x1874546707670144:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707255.173345:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707670272 00000100:00100000:1.0:1787707255.173350:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707670272 00000100:00100000:1.0:1787707255.173738:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 69 00000100:00100000:1.0:1787707255.173747:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2362:x1874546707670272:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707255.173853:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2362:x1874546707670272:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 107us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707255.173862:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 69 00000100:00080000:1.0:1787707255.173895:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707255.174543:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+10:2362:x1874546707670144:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 1509us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707255.174553:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 208 00010000:00010000:1.0:1787707256.062203:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707257.084579:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707257.146181:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729727232:0@lo:400:kworker.0 00000100:00100000:2.0:1787707257.146276:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707257.146355:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787707257.146364:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729726848:0@lo:400:kworker.0 00000100:00100000:2.0:1787707257.146428:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707257.146460:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729727360:0@lo:400:kworker.0 00000100:00100000:2.0:1787707257.146490:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707257.146544:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729727104:0@lo:400:kworker.0 00000100:00100000:2.0:1787707257.146576:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707257.146601:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787707257.146609:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729726976:0@lo:400:kworker.0 00000100:00100000:3.0:1787707257.146617:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729727360 00000100:00100000:3.0:1787707257.146636:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729727360 00000100:00100000:2.0:1787707257.146637:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707257.146661:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729727488:0@lo:400:kworker.0 00000100:00100000:2.0:1787707257.146702:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707257.146726:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729727104 00000100:00100000:3.0:1787707257.146731:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729727104 00000100:00100000:3.0:1787707257.146751:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729726976 00000100:00100000:3.0:1787707257.146754:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729726976 00000100:00100000:3.0:1787707257.146776:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787707257.146787:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729727360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707257.146874:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729727360:12345-0@lo:400:kworker.0 Request processed in 88us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707257.146882:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787707257.146901:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787707257.146908:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729727104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707257.146945:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729727104:12345-0@lo:400:kworker.0 Request processed in 38us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707257.146952:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787707257.146964:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787707257.146972:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729726976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707257.147004:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729726976:12345-0@lo:400:kworker.0 Request processed in 33us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707257.147022:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787707257.148036:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729726848 00000100:00100000:2.0:1787707257.148046:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729726848 00000100:00100000:2.0:1787707257.148094:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787707257.148104:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729726848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707257.148188:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729726848:12345-0@lo:400:kworker.0 Request processed in 86us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707257.148196:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787707257.148238:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729727232 00000100:00100000:2.0:1787707257.148243:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729727232 00000100:00100000:2.0:1787707257.148275:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729727488 00000100:00100000:2.0:1787707257.148279:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729727488 00000100:00100000:2.0:1787707257.148313:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787707257.148320:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729727232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707257.148359:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729727232:12345-0@lo:400:kworker.0 Request processed in 39us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707257.148366:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1787707257.149630:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787707257.149640:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787707257.149644:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707257.150973:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787707257.151007:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729727488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707257.151131:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729727488:12345-0@lo:400:kworker.0 Request processed in 145us (4429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707257.151139:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787707257.151758:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729726976:0@lo:400:kworker.0 00010000:00080000:2.0:1787707257.151780:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41ca0700 x1874546729727488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707257.151793:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729727488:0@lo:400:kworker.0 00000100:00100000:2.0:1787707257.151807:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729727104:0@lo:400:kworker.0 00000100:00100000:2.0:1787707257.151859:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729726848:0@lo:400:kworker.0 00000100:00100000:2.0:1787707257.151875:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729727360:0@lo:400:kworker.0 00010000:00080000:2.0:1787707257.151889:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41ca0e00 x1874546729727232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707257.151899:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729727232:0@lo:400:kworker.0 00000100:00100000:2.0:1787707257.656852:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729727616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787707257.656959:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707257.659791:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729727616 00000100:00100000:3.0:1787707257.659809:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729727616 00000100:00100000:3.0:1787707257.659882:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787707257.659895:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729727616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787707257.659943:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707257.661973:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729727616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2070us (5003us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707257.662003:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1787707257.665254:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa07330380 x1874546729727616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707257.665350:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729727616:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787707258.117957:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707259.132897:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707260.152642:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707260.216586:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787707260.216610:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729727744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787707260.216704:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707260.216807:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729727744 00000100:00100000:2.0:1787707260.216817:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729727744 00000100:00100000:2.0:1787707260.216891:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787707260.216901:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729727744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787707260.216938:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707260.216983:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729727744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707260.216990:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1787707260.217101:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787707260.217135:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41ca2a00 x1874546729727744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707260.217155:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729727744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787707260.291010:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707260.291089:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707670400 00000100:00100000:3.0:1787707260.291100:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707670400 00000100:00100000:3.0:1787707260.291156:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 210 00000100:00100000:3.0:1787707260.291166:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+10:2361:x1874546707670400:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707260.291339:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+10:2361:x1874546707670400:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 172us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707260.291348:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 210 00000100:00100000:1.0:1787707260.291422:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707260.291472:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707670528 00000100:00100000:3.0:1787707260.291478:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707670528 00000100:00100000:3.0:1787707260.291531:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 73 00000100:00100000:3.0:1787707260.291538:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2361:x1874546707670528:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707260.291566:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2361:x1874546707670528:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 30us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707260.291572:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 73 00000100:00080000:1.0:1787707260.291745:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787707261.179335:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707262.202736:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707262.274689:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729727872:0@lo:400:kworker.0 00000100:00100000:1.0:1787707262.274766:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707262.274840:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729727872 00000100:00100000:1.0:1787707262.274849:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729727872 00000100:00100000:1.0:1787707262.274913:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787707262.274924:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729727872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707262.274979:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729727872:12345-0@lo:400:kworker.0 Request processed in 57us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707262.274986:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787707262.275037:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729727872:0@lo:400:kworker.0 00000100:00100000:1.0:1787707262.275078:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787707262.275086:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729728000:0@lo:400:kworker.0 00000100:00100000:1.0:1787707262.275129:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707262.275161:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729728000 00000100:00100000:1.0:1787707262.275165:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729728000 00000100:00100000:1.0:1787707262.275193:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787707262.275200:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729728000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707262.275238:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729728000:12345-0@lo:400:kworker.0 Request processed in 39us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707262.275261:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787707262.275291:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729728000:0@lo:400:kworker.0 00000100:00100000:1.0:1787707262.275319:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729728128:0@lo:400:kworker.0 00000100:00100000:1.0:1787707262.275343:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707262.275401:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729728128 00000100:00100000:1.0:1787707262.275405:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729728128 00000100:00100000:1.0:1787707262.275436:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787707262.275443:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729728128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707262.275490:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729728128:12345-0@lo:400:kworker.0 Request processed in 47us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707262.275496:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787707262.275512:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787707262.275532:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729728128:0@lo:400:kworker.0 00000100:00100000:1.0:1787707262.275561:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729728256:0@lo:400:kworker.0 00000100:00100000:1.0:1787707262.275599:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707262.275639:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729728384:0@lo:400:kworker.0 00000100:00100000:1.0:1787707262.275659:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707262.275680:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729728384 00000100:00100000:1.0:1787707262.275684:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729728384 00000100:00100000:1.0:1787707262.275707:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787707262.275713:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729728384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707262.275743:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729728384:12345-0@lo:400:kworker.0 Request processed in 30us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707262.275749:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1787707262.275761:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787707262.275776:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729728384:0@lo:400:kworker.0 00000100:00100000:1.0:1787707262.275802:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787707262.275807:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729728512:0@lo:400:kworker.0 00000100:00100000:1.0:1787707262.275827:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707262.275849:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729728256 00000100:00100000:1.0:1787707262.275858:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729728256 00000100:00100000:1.0:1787707262.275886:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729728512 00000100:00100000:1.0:1787707262.275888:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729728512 00000100:00100000:1.0:1787707262.275904:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787707262.275909:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729728256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707262.275939:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729728256:12345-0@lo:400:kworker.0 Request processed in 30us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707262.275944:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787707262.275954:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787707262.275958:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729728512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707262.275980:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729728512:12345-0@lo:400:kworker.0 Request processed in 22us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707262.275985:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1787707262.275996:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787707262.275998:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787707262.276018:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41ca4a80 x1874546729728256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707262.276029:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729728256:0@lo:400:kworker.0 00010000:00080000:1.0:1787707262.276048:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41ca5180 x1874546729728512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707262.276057:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729728512:0@lo:400:kworker.0 00000100:00100000:1.0:1787707262.779479:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787707262.779503:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729728640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787707262.779583:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707262.779658:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729728640 00000100:00100000:1.0:1787707262.779667:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729728640 00000100:00100000:1.0:1787707262.779723:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787707262.779732:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729728640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787707262.779767:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787707262.779812:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729728640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707262.779820:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1787707262.779863:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41ca5180 x1874546729728640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707262.779883:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729728640:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1787707262.817218:0:10124:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 21:21:00 (1787707260) === 00010000:00010000:3.0:1787707263.224757:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707263.407830:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707263.407931:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707670656 00000100:00100000:3.0:1787707263.407941:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707670656 00000100:00100000:3.0:1787707263.408082:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 212 00000100:00100000:3.0:1787707263.408094:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+10:8159:x1874546707670656:12345-192.168.204.46@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787707263.408111:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707263.408129:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa00031e00/0xc5f18d5f94ec09b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9be0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707263.408175:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa00031e00/0xc5f18d5f94ec09b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9be0 expref: 11 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707263.408187:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa00031e00/0xc5f18d5f94ec09b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9be0 expref: 11 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707263.408197:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa00031e00, rc 0) 00000100:00100000:3.0:1787707263.408264:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+11:8159:x1874546707670656:12345-192.168.204.46@tcp:101:mount.lustre.0 Request processed in 172us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707263.408271:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 212 00000100:00100000:1.0:1787707263.415844:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707263.419839:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707670784 00000100:00100000:3.0:1787707263.419857:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707670784 00000100:00100000:3.0:1787707263.420090:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 213 00000100:00100000:3.0:1787707263.420104:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+11:8159:x1874546707670784:12345-192.168.204.46@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787707263.420472:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+11:8159:x1874546707670784:12345-192.168.204.46@tcp:501:mount.lustre.0 Request processed in 370us (4640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707263.420481:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 213 00000100:00100000:0.0:1787707263.444934:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707263.445107:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707670912 00000100:00100000:1.0:1787707263.445119:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707670912 00000100:00100000:1.0:1787707263.445179:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 214 00000100:00100000:1.0:1787707263.445189:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+11:8159:x1874546707670912:12345-192.168.204.46@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787707263.445467:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+11:8159:x1874546707670912:12345-192.168.204.46@tcp:503:mount.lustre.0 Request processed in 278us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707263.445476:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 214 00000100:00100000:1.0:1787707263.467474:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707263.467707:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707671040 00000100:00100000:3.0:1787707263.467718:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707671040 00000100:00100000:3.0:1787707263.467774:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 215 00000100:00100000:3.0:1787707263.467785:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+11:8163:x1874546707671040:12345-192.168.204.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787707263.468297:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+11:8163:x1874546707671040:12345-192.168.204.46@tcp:502:llog_process_th.0 Request processed in 513us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707263.468306:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 215 00000100:00100000:3.0:1787707263.491538:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707263.491819:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707671168 00000100:00100000:2.0:1787707263.491829:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707671168 00000100:00100000:2.0:1787707263.491902:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 216 00000100:00100000:2.0:1787707263.491915:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+11:8163:x1874546707671168:12345-192.168.204.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787707263.492217:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+11:8163:x1874546707671168:12345-192.168.204.46@tcp:502:llog_process_th.0 Request processed in 303us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707263.492226:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 216 00000100:00100000:0.0:1787707263.494478:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707263.496843:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707671296 00000100:00100000:3.0:1787707263.496859:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707671296 00000100:00100000:3.0:1787707263.496942:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 217 00000100:00100000:3.0:1787707263.496953:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+11:8159:x1874546707671296:12345-192.168.204.46@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787707263.496969:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707263.496986:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa00030000/0xc5f18d5f94ec09bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9c0a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707263.497013:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa00030000/0xc5f18d5f94ec09bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c0a expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707263.497024:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa00030000/0xc5f18d5f94ec09bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c0a expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707263.497032:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa00030000, rc 0) 00000100:00100000:3.0:1787707263.497103:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+12:8159:x1874546707671296:12345-192.168.204.46@tcp:101:mount.lustre.0 Request processed in 153us (2632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707263.497109:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 217 00000100:00100000:3.0:1787707263.501006:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707263.504446:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707671424 00000100:00100000:1.0:1787707263.504465:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707671424 00000100:00100000:1.0:1787707263.504539:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 218 00000100:00100000:1.0:1787707263.504567:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+12:8159:x1874546707671424:12345-192.168.204.46@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787707263.504597:0:5851:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787707263.504622:0:5851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787707263.504633:0:5851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787707263.504636:0:5851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787707263.504639:0:5851:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787707263.508985:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+12:8159:x1874546707671424:12345-192.168.204.46@tcp:256:mount.lustre.0 Request processed in 4423us (7976us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707263.509001:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 218 00000100:00100000:0.0:1787707263.534627:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707263.534879:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707671552 00000100:00100000:3.0:1787707263.534890:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707671552 00000100:00100000:3.0:1787707263.535233:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 219 00000100:00100000:3.0:1787707263.535246:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+12:8159:x1874546707671552:12345-192.168.204.46@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787707263.535264:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707263.535298:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa00031200/0xc5f18d5f94ec09c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9c11 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707263.535327:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa00031200/0xc5f18d5f94ec09c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c11 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707263.535338:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa00031200/0xc5f18d5f94ec09c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c11 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707263.535347:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa00031200, rc 0) 00000100:00100000:2.0:1787707263.539252:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:8159:x1874546707671552:12345-192.168.204.46@tcp:101:mount.lustre.0 Request processed in 3993us (4620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707263.539268:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 219 00000100:00100000:1.0:1787707263.552671:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707263.553574:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707671680 00000100:00100000:3.0:1787707263.553586:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707671680 00000100:00100000:3.0:1787707263.553651:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 220 00000100:00100000:3.0:1787707263.553661:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+13:8159:x1874546707671680:12345-192.168.204.46@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787707263.553978:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+13:8159:x1874546707671680:12345-192.168.204.46@tcp:501:mount.lustre.0 Request processed in 317us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707263.553986:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 220 00000100:00100000:1.0:1787707263.556633:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707263.560563:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707671808 00000100:00100000:2.0:1787707263.560580:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707671808 00000100:00100000:2.0:1787707263.560665:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 221 00000100:00100000:2.0:1787707263.560676:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:8159:x1874546707671808:12345-192.168.204.46@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787707263.560926:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:8159:x1874546707671808:12345-192.168.204.46@tcp:503:mount.lustre.0 Request processed in 251us (4303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707263.560935:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 221 00000100:00100000:0.0:1787707263.568056:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707263.568168:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707671936 00000100:00100000:1.0:1787707263.568179:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707671936 00000100:00100000:1.0:1787707263.568243:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 222 00000100:00100000:1.0:1787707263.568253:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:8165:x1874546707671936:12345-192.168.204.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787707263.568743:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:8165:x1874546707671936:12345-192.168.204.46@tcp:502:llog_process_th.0 Request processed in 490us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707263.568753:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 222 00000100:00100000:1.0:1787707263.581921:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707263.582102:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707672064 00000100:00100000:3.0:1787707263.582113:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707672064 00000100:00100000:3.0:1787707263.582176:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 223 00000100:00100000:3.0:1787707263.582187:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+13:8165:x1874546707672064:12345-192.168.204.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787707263.582476:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+13:8165:x1874546707672064:12345-192.168.204.46@tcp:502:llog_process_th.0 Request processed in 290us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707263.582484:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 223 00000100:00100000:3.0:1787707263.610279:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707263.610343:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707263.610610:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707672576 00000100:00100000:0.0:1787707263.610623:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707672576 00000100:00100000:0.0:1787707263.610690:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707672192 00000100:00100000:0.0:1787707263.610694:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707672192 00000100:00100000:0.0:1787707263.610715:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 77 00000100:00100000:0.0:1787707263.610726:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2360:x1874546707672576:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707263.610808:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2360:x1874546707672576:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 84us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707263.610816:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 77 00000100:00100000:0.0:1787707263.610834:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 10 00000100:00100000:0.0:1787707263.610839:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1874546707672192:12345-192.168.204.46@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787707263.610866:0:5857:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-MDT0000: connection from 07fb5f38-6916-4d1b-963f-1397d7cf8aaf@192.168.204.46@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:0.0:1787707263.610935:0:5857:0:(genops.c:1385:class_connect()) connect: client 07fb5f38-6916-4d1b-963f-1397d7cf8aaf, cookie 0xc5f18d5f94ec09ca 00000004:00100000:0.0:1787707263.610969:0:5857:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787707263.611240:0:5857:0:(import.c:65:import_set_state_nolock()) ffff8cfa2f345000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787707263.611271:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+6:2358:x1874546707672192:12345-192.168.204.46@tcp:38:mount.lustre.0 Request processed in 431us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707263.611279:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 10 00000100:00080000:2.0:1787707263.612998:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707263.619067:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707263.619117:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707263.619513:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707672320 00000100:00100000:2.0:1787707263.619533:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707672320 00000100:00100000:2.0:1787707263.619625:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707672448 00000100:00100000:2.0:1787707263.619629:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707672448 00000100:00100000:2.0:1787707263.619652:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 11 00000100:00100000:2.0:1787707263.619662:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+7:0:x1874546707672320:12345-192.168.204.46@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787707263.619708:0:5858:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787707263.619790:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+7:0:x1874546707672320:12345-192.168.204.46@tcp:41:mount.lustre.0 Request processed in 129us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707263.619797:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 11 00000100:00100000:2.0:1787707263.619815:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 12 00000100:00100000:2.0:1787707263.619821:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+6:8159:x1874546707672448:12345-192.168.204.46@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787707263.619831:0:5858:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787707263.619850:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+6:8159:x1874546707672448:12345-192.168.204.46@tcp:41:mount.lustre.0 Request processed in 29us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707263.619856:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 12 00000100:00080000:3.0:1787707263.620003:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787707263.625245:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707263.630748:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707672704 00000100:00100000:2.0:1787707263.630766:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707672704 00000100:00100000:2.0:1787707263.630914:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 13 00000100:00100000:2.0:1787707263.630926:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+6:8159:x1874546707672704:12345-192.168.204.46@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787707263.631026:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+6:8159:x1874546707672704:12345-192.168.204.46@tcp:40:mount.lustre.0 Request processed in 102us (5790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707263.631048:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 13 00000100:00100000:3.0:1787707263.637774:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707263.637829:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707263.637858:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707263.637890:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707672832 00000100:00100000:3.0:1787707263.637912:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707672832 00000100:00100000:3.0:1787707263.637946:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707672960 00000100:00100000:3.0:1787707263.637950:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707672960 00000100:00100000:3.0:1787707263.637969:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 12 00000100:00100000:3.0:1787707263.637977:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1874546707672832:12345-192.168.204.46@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787707263.638012:0:6689:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-OST0000: connection from 07fb5f38-6916-4d1b-963f-1397d7cf8aaf@192.168.204.46@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:3.0:1787707263.638045:0:6689:0:(genops.c:1385:class_connect()) connect: client 07fb5f38-6916-4d1b-963f-1397d7cf8aaf, cookie 0xc5f18d5f94ec09d1 00002000:00100000:3.0:1787707263.638057:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 07fb5f38-6916-4d1b-963f-1397d7cf8aaf/ffff8cfa3cbaa800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787707263.638083:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787707263.638325:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787707263.638355:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8cfa3cba9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787707263.638454:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+6:2358:x1874546707672832:12345-192.168.204.46@tcp:8:mount.lustre.0 Request processed in 475us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707263.638463:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 12 00000100:00100000:3.0:1787707263.638483:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 13 00000100:00100000:3.0:1787707263.638488:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1874546707672960:12345-192.168.204.46@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787707263.638504:0:6689:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-OST0001: connection from 07fb5f38-6916-4d1b-963f-1397d7cf8aaf@192.168.204.46@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:3.0:1787707263.638521:0:6689:0:(genops.c:1385:class_connect()) connect: client 07fb5f38-6916-4d1b-963f-1397d7cf8aaf, cookie 0xc5f18d5f94ec09d8 00002000:00100000:3.0:1787707263.638526:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 07fb5f38-6916-4d1b-963f-1397d7cf8aaf/ffff8cfa3cbac000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787707263.638532:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787707263.638671:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787707263.638699:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8cfa3cbaf000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787707263.638725:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+6:2358:x1874546707672960:12345-192.168.204.46@tcp:8:mount.lustre.0 Request processed in 235us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707263.638733:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 13 00000100:00100000:0.0:1787707263.639360:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707673088 00000100:00100000:0.0:1787707263.639397:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707673088 00000100:00100000:0.0:1787707263.639435:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 1 00000100:00100000:0.0:1787707263.639443:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+6:8159:x1874546707673088:12345-192.168.204.46@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787707263.639655:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787707263.639782:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+6:8159:x1874546707673088:12345-192.168.204.46@tcp:33:mount.lustre.0 Request processed in 339us (2018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707263.639791:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 1 00000001:00100000:3.0:1787707263.869457:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 07fb5f38-6916-4d1b-963f-1397d7cf8aaf 00010000:00010000:1.0:1787707264.248686:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787707264.364286:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 07fb5f38-6916-4d1b-963f-1397d7cf8aaf 00000001:00100000:0.0:1787707264.938342:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 07fb5f38-6916-4d1b-963f-1397d7cf8aaf 00010000:00010000:0.0:1787707265.298444:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707265.338244:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729728768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787707265.338318:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707265.338462:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729728768 00000100:00100000:0.0:1787707265.338470:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729728768 00000100:00100000:0.0:1787707265.338542:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787707265.338562:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729728768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787707265.338595:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707265.348533:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729728768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9952us (10194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707265.348559:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787707265.348731:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787707265.358434:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41ca6a00 x1874546729728768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707265.358467:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729728768:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787707266.297612:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707267.321571:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707267.384727:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2a5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729729024:0@lo:400:kworker.0 00000100:00100000:3.0:1787707267.384827:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707267.384925:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2a5b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729729536:0@lo:400:kworker.0 00000100:00100000:3.0:1787707267.384967:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707267.385003:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787707267.385009:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2a5b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729729152:0@lo:400:kworker.0 00000100:00100000:3.0:1787707267.385034:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707267.385074:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729728896:0@lo:400:kworker.0 00000100:00100000:3.0:1787707267.385080:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729729024 00000100:00100000:3.0:1787707267.385091:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729729024 00000100:00100000:0.0:1787707267.385132:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707267.385155:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729729152 00000100:00100000:3.0:1787707267.385160:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729729152 00000100:00100000:0.0:1787707267.385181:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2a5b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729729408:0@lo:400:kworker.0 00000100:00100000:3.0:1787707267.385204:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787707267.385218:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729729024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707267.385219:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707267.385244:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787707267.385253:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2a5bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729729280:0@lo:400:kworker.0 00000100:00100000:3.0:1787707267.385299:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729729024:12345-0@lo:400:kworker.0 Request processed in 83us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707267.385302:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707267.385317:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787707267.385337:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729729408 00000100:00100000:3.0:1787707267.385341:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729729408 00000100:00100000:0.0:1787707267.385364:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729728896 00000100:00100000:3.0:1787707267.385392:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787707267.385401:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729729152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707267.385411:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729728896 00000100:00100000:3.0:1787707267.385440:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729729152:12345-0@lo:400:kworker.0 Request processed in 39us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707267.385447:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787707267.385463:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787707267.385467:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787707267.385476:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729729408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707267.385495:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729728896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707267.385526:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729729408:12345-0@lo:400:kworker.0 Request processed in 50us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707267.385532:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787707267.385554:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729729536 00000100:00100000:3.0:1787707267.385559:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729729536 00000100:00100000:0.0:1787707267.385564:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729728896:12345-0@lo:400:kworker.0 Request processed in 91us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707267.385585:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787707267.385589:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729729280 00000100:00100000:3.0:1787707267.385594:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729729280 00000100:00100000:3.0:1787707267.385622:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787707267.385631:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729729536:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787707267.385633:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787707267.385642:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787707267.385646:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707267.385674:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729729536:12345-0@lo:400:kworker.0 Request processed in 43us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707267.385681:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787707267.385875:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787707267.385882:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729729280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707267.385913:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729729280:12345-0@lo:400:kworker.0 Request processed in 32us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707267.385927:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1787707267.386004:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa2a5bbb80 x1874546729729280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707267.386023:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2a5bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729729280:0@lo:400:kworker.0 00000100:00100000:3.0:1787707267.386036:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729728896:0@lo:400:kworker.0 00000100:00100000:3.0:1787707267.386050:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2a5b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729729408:0@lo:400:kworker.0 00000100:00100000:3.0:1787707267.386096:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2a5b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729729152:0@lo:400:kworker.0 00000100:00100000:3.0:1787707267.386110:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2a5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729729024:0@lo:400:kworker.0 00010000:00080000:3.0:1787707267.386123:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa2a5b8380 x1874546729729536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707267.386132:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2a5b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729729536:0@lo:400:kworker.0 00000100:00100000:0.0:1787707267.896758:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787707267.896870:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729729664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787707267.897332:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707267.897453:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729729664 00000100:00100000:1.0:1787707267.897465:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729729664 00000100:00100000:1.0:1787707267.897548:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787707267.897561:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729729664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787707267.897609:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787707267.897675:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729729664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707267.897683:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1787707267.897890:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41ca4700 x1874546729729664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707267.897914:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729729664:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787707268.347171:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707269.012138:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707269.012196:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707269.012241:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707269.012275:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707269.012311:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707269.012347:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707673472 00000100:00100000:3.0:1787707269.012361:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707673472 00000100:00100000:3.0:1787707269.012492:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707673344 00000100:00100000:3.0:1787707269.012497:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707673344 00000100:00100000:3.0:1787707269.012526:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 81 00000100:00100000:3.0:1787707269.012539:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2362:x1874546707673472:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707269.012660:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2362:x1874546707673472:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 122us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707269.012688:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 81 00000100:00100000:3.0:1787707269.012709:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 82 00000100:00100000:3.0:1787707269.012717:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2362:x1874546707673344:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707269.012746:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2362:x1874546707673344:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 29us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707269.012752:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 82 00000100:00100000:3.0:1787707269.012774:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707673728 00000100:00100000:3.0:1787707269.012778:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707673728 00000100:00100000:3.0:1787707269.012807:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707673600 00000100:00100000:3.0:1787707269.012810:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707673600 00000100:00100000:3.0:1787707269.012832:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 44 00000100:00100000:3.0:1787707269.012840:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2362:x1874546707673728:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707269.012870:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2362:x1874546707673728:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 32us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707269.012877:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 44 00000100:00100000:3.0:1787707269.012888:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 45 00000100:00100000:3.0:1787707269.012894:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2362:x1874546707673600:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707269.012918:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2362:x1874546707673600:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 25us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707269.012925:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 45 00000100:00080000:3.0:1787707269.012943:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787707269.012948:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787707269.012951:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787707269.013806:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707673216 00000100:00100000:1.0:1787707269.013812:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707673216 00000100:00100000:1.0:1787707269.013866:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 225 00000100:00100000:1.0:1787707269.013876:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:2362:x1874546707673216:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707269.013946:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:2362:x1874546707673216:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 72us (1824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707269.013953:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 225 00010000:00010000:3.0:1787707269.369031:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787707270.173212:0:10321:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg446-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1787707270.401237:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707270.456825:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729729792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787707270.456898:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707270.456965:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729729792 00000100:00100000:1.0:1787707270.456973:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729729792 00000100:00100000:1.0:1787707270.457024:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787707270.457259:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729729792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787707270.457294:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787707270.458717:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729729792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1455us (1812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707270.458728:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1787707270.458762:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787707270.464187:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41ca5f80 x1874546729729792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707270.464221:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729729792:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787707271.419139:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707272.448732:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707272.504937:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729729920:0@lo:400:kworker.0 00000100:00100000:1.0:1787707272.505010:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707272.505073:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729730432:0@lo:400:kworker.0 00000100:00100000:1.0:1787707272.505103:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707272.505129:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787707272.505134:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729730304:0@lo:400:kworker.0 00000100:00100000:1.0:1787707272.505158:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707272.505187:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729730048:0@lo:400:kworker.0 00000100:00100000:1.0:1787707272.505211:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707272.505228:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729730560:0@lo:400:kworker.0 00000100:00100000:1.0:1787707272.505277:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707272.505298:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787707272.505304:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729730176:0@lo:400:kworker.0 00000100:00100000:1.0:1787707272.505324:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707272.505354:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729729920 00000100:00100000:1.0:1787707272.505361:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729729920 00000100:00100000:1.0:1787707272.506639:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787707272.506651:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729729920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707272.506804:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729729920:12345-0@lo:400:kworker.0 Request processed in 154us (1793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707272.506812:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787707272.506851:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729730432 00000100:00100000:1.0:1787707272.506857:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729730432 00000100:00100000:1.0:1787707272.506900:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729730048 00000100:00100000:1.0:1787707272.506903:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729730048 00000100:00100000:1.0:1787707272.506916:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729730176 00000100:00100000:1.0:1787707272.506919:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729730176 00000100:00100000:1.0:1787707272.506934:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787707272.506941:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729730432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707272.506975:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729730432:12345-0@lo:400:kworker.0 Request processed in 34us (1871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707272.506980:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787707272.506991:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787707272.506997:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729730048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707272.507028:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729730048:12345-0@lo:400:kworker.0 Request processed in 31us (1816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707272.507034:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787707272.507055:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787707272.507060:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729730176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707272.507085:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729730176:12345-0@lo:400:kworker.0 Request processed in 25us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707272.507090:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787707272.507105:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729730304 00000100:00100000:1.0:1787707272.507108:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729730304 00000100:00100000:1.0:1787707272.507135:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729730560 00000100:00100000:1.0:1787707272.507138:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729730560 00000100:00100000:1.0:1787707272.507240:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787707272.507248:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729730304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707272.507280:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729730304:12345-0@lo:400:kworker.0 Request processed in 33us (2121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707272.507285:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787707272.507297:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787707272.507303:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729730560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707272.507327:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729730560:12345-0@lo:400:kworker.0 Request processed in 25us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707272.507332:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1787707272.507359:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787707272.507362:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787707272.507364:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787707272.507435:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729730176:0@lo:400:kworker.0 00000100:00100000:1.0:1787707272.507448:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729730048:0@lo:400:kworker.0 00010000:00080000:1.0:1787707272.507464:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41ca6300 x1874546729730560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707272.507488:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729730560:0@lo:400:kworker.0 00010000:00080000:1.0:1787707272.507524:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41ca5880 x1874546729730304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707272.507533:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729730304:0@lo:400:kworker.0 00000100:00100000:1.0:1787707272.507540:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729729920:0@lo:400:kworker.0 00000100:00100000:1.0:1787707272.507549:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729730432:0@lo:400:kworker.0 00000100:00100000:3.0:1787707273.019220:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729730688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787707273.019290:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707273.019957:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729730688 00000100:00100000:2.0:1787707273.019966:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729730688 00000100:00100000:2.0:1787707273.020021:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787707273.020031:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729730688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787707273.020069:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707273.020124:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729730688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707273.020132:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1787707273.020169:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41ca0000 x1874546729730688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707273.020188:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729730688:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787707273.464520:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707274.121149:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707274.121184:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707274.121217:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707274.121253:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707274.121289:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707274.121297:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707674112 00000100:00100000:3.0:1787707274.121315:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707674112 00000100:00100000:0.0:1787707274.121331:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707674368 00000100:00100000:0.0:1787707274.121342:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707674368 00000100:00100000:0.0:1787707274.121453:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707674240 00000100:00100000:0.0:1787707274.121457:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707674240 00000100:00100000:3.0:1787707274.121471:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707673984 00000100:00100000:3.0:1787707274.121477:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707673984 00000100:00100000:0.0:1787707274.121504:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 48 00000100:00100000:0.0:1787707274.121523:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2359:x1874546707674368:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707274.121533:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 86 00000100:00100000:3.0:1787707274.121549:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2359:x1874546707674112:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707274.121611:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2359:x1874546707674368:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 95us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707274.121619:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 48 00000100:00100000:0.0:1787707274.121638:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 49 00000100:00100000:3.0:1787707274.121697:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2359:x1874546707674112:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 151us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707274.121706:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 86 00000100:00100000:2.0:1787707274.121753:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707673856 00000100:00100000:2.0:1787707274.121759:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707673856 00000100:00100000:3.0:1787707274.121803:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 87 00000100:00100000:2.0:1787707274.121808:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 227 00000100:00100000:3.0:1787707274.121821:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2359:x1874546707673984:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707274.121824:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:2359:x1874546707673856:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707274.121867:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2359:x1874546707673984:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 50us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707274.121880:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:2359:x1874546707673856:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 58us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707274.121881:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 87 00000100:00100000:2.0:1787707274.121899:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 227 00000100:00080000:3.0:1787707274.121917:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787707274.121924:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787707274.122083:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2359:x1874546707674240:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707274.122112:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2359:x1874546707674240:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 469us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707274.122119:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 49 00000100:00080000:3.0:1787707274.122882:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787707274.488618:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707275.512577:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707275.576986:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787707275.577020:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729730816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787707275.577121:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707275.577293:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729730816 00000100:00100000:1.0:1787707275.577304:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729730816 00000100:00100000:1.0:1787707275.577424:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787707275.577436:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729730816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787707275.577485:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787707275.577545:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729730816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707275.577553:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1787707275.577602:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41ca7800 x1874546729730816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707275.577626:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729730816:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787707275.578007:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787707276.537422:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707277.565258:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707277.626657:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787707277.626688:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa07331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729730944:0@lo:400:kworker.0 00000100:00100000:0.0:1787707277.626791:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707277.626909:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729731072:0@lo:400:kworker.0 00000100:00100000:0.0:1787707277.626944:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707277.626987:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729731072 00000100:00100000:0.0:1787707277.626995:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729731072 00000100:00100000:0.0:1787707277.627053:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787707277.627064:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729731072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707277.627126:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729731072:12345-0@lo:400:kworker.0 Request processed in 64us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707277.627134:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787707277.627186:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729731072:0@lo:400:kworker.0 00000100:00100000:0.0:1787707277.627220:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787707277.627225:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729731200:0@lo:400:kworker.0 00000100:00100000:0.0:1787707277.627249:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707277.627274:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729731200 00000100:00100000:0.0:1787707277.627278:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729731200 00000100:00100000:0.0:1787707277.627328:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787707277.627335:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729731200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707277.627396:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729731200:12345-0@lo:400:kworker.0 Request processed in 35us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707277.627403:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1787707277.627420:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707277.627442:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729731200:0@lo:400:kworker.0 00000100:00100000:0.0:1787707277.627474:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729731328:0@lo:400:kworker.0 00000100:00100000:0.0:1787707277.627524:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707277.627558:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729731328 00000100:00100000:0.0:1787707277.627561:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729731328 00000100:00100000:0.0:1787707277.627603:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787707277.627610:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729731328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707277.627646:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729731328:12345-0@lo:400:kworker.0 Request processed in 37us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707277.627653:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1787707277.627673:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787707277.627691:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa07330380 x1874546729731328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707277.627704:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729731328:0@lo:400:kworker.0 00000100:00100000:0.0:1787707277.627736:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787707277.627742:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729731456:0@lo:400:kworker.0 00000100:00100000:0.0:1787707277.627767:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707277.627789:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729731456 00000100:00100000:0.0:1787707277.627793:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729731456 00000100:00100000:0.0:1787707277.627819:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787707277.627825:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729731456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707277.627860:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729731456:12345-0@lo:400:kworker.0 Request processed in 34us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707277.627865:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1787707277.627881:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707277.627897:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729731456:0@lo:400:kworker.0 00000100:00100000:0.0:1787707277.627927:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729731584:0@lo:400:kworker.0 00000100:00100000:0.0:1787707277.627950:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707277.627975:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729731584 00000100:00100000:0.0:1787707277.627979:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729731584 00000100:00100000:0.0:1787707277.628006:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787707277.628019:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729731584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707277.628056:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729731584:12345-0@lo:400:kworker.0 Request processed in 38us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707277.628062:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1787707277.628081:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787707277.628096:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3fcbf480 x1874546729731584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707277.628106:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729731584:0@lo:400:kworker.0 00000100:00100000:1.0:1787707277.628772:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729730944 00000100:00100000:1.0:1787707277.628781:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729730944 00000100:00100000:1.0:1787707277.628830:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787707277.628839:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729730944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707277.628906:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729730944:12345-0@lo:400:kworker.0 Request processed in 68us (2115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707277.628914:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787707277.630812:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa07331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729730944:0@lo:400:kworker.0 00000100:00100000:0.0:1787707278.146513:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787707278.146543:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729731712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787707278.146649:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707278.146941:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729731712 00000100:00100000:1.0:1787707278.146952:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729731712 00000100:00100000:1.0:1787707278.147024:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787707278.147037:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729731712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787707278.147084:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787707278.147146:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729731712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707278.147166:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787707278.147216:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41ca7800 x1874546729731712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707278.147239:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729731712:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787707278.587701:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707279.239984:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707279.240032:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707279.240075:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707279.240082:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707674496 00000100:00100000:1.0:1787707279.240096:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707674496 00000100:00100000:2.0:1787707279.240112:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707279.240205:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707279.240296:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 229 00000100:00100000:1.0:1787707279.240310:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+13:2361:x1874546707674496:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707279.240471:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707675008 00000100:00100000:3.0:1787707279.240477:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707675008 00000100:00100000:3.0:1787707279.240527:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707674880 00000100:00100000:3.0:1787707279.240530:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707674880 00000100:00100000:3.0:1787707279.240551:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 52 00000100:00100000:3.0:1787707279.240560:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2361:x1874546707675008:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707279.240604:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2361:x1874546707675008:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 36us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707279.240612:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 52 00000100:00100000:3.0:1787707279.240631:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 53 00000100:00100000:3.0:1787707279.240638:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2362:x1874546707674880:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707279.240665:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+13:2361:x1874546707674496:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 356us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707279.240666:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2362:x1874546707674880:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 27us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707279.240680:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 53 00000100:00100000:1.0:1787707279.240684:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 229 00000100:00080000:2.0:1787707279.240920:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787707279.240926:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787707279.241290:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707674752 00000100:00100000:0.0:1787707279.241297:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707674752 00000100:00100000:0.0:1787707279.241364:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707674624 00000100:00100000:0.0:1787707279.241367:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707674624 00000100:00100000:0.0:1787707279.241422:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 91 00000100:00100000:0.0:1787707279.241430:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2361:x1874546707674752:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707279.241469:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2361:x1874546707674752:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 40us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707279.241476:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 91 00000100:00100000:0.0:1787707279.241489:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 92 00000100:00100000:0.0:1787707279.241495:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2362:x1874546707674624:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707279.241512:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2362:x1874546707674624:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 18us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707279.241530:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 92 00000100:00080000:2.0:1787707279.241789:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787707279.614481:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707280.635504:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707280.696759:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787707280.696791:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729731840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787707280.696891:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707280.697351:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729731840 00000100:00100000:1.0:1787707280.697365:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729731840 00000100:00100000:1.0:1787707280.697479:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787707280.697491:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729731840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787707280.697723:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787707280.697856:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787707280.700271:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729731840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2768us (3366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707280.700289:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1787707280.701063:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41ca7800 x1874546729731840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707280.701095:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729731840:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787707281.656645:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707282.685013:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707282.747329:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729731968:0@lo:400:kworker.0 00000100:00100000:3.0:1787707282.747750:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707282.747866:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729731968 00000100:00100000:1.0:1787707282.747875:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729731968 00000100:00100000:1.0:1787707282.747931:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787707282.747941:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729731968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707282.747993:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729731968:12345-0@lo:400:kworker.0 Request processed in 53us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707282.748000:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787707282.748566:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729731968:0@lo:400:kworker.0 00000100:00100000:3.0:1787707282.748741:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787707282.748845:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787707282.748856:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729732224:0@lo:400:kworker.0 00000100:00100000:1.0:1787707282.748893:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707282.748948:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729732096:0@lo:400:kworker.0 00000100:00100000:3.0:1787707282.748992:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707282.749350:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729732352:0@lo:400:kworker.0 00000100:00100000:3.0:1787707282.749400:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707282.749506:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729732224 00000100:00100000:1.0:1787707282.749512:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729732224 00000100:00100000:1.0:1787707282.749570:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729732096 00000100:00100000:1.0:1787707282.749573:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729732096 00000100:00100000:1.0:1787707282.749593:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787707282.749601:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729732224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707282.749646:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729732224:12345-0@lo:400:kworker.0 Request processed in 45us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707282.749653:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787707282.749668:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787707282.749675:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729732096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707282.749705:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729732096:12345-0@lo:400:kworker.0 Request processed in 31us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707282.749719:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1787707282.749749:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707282.749891:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787707282.749899:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729732480:0@lo:400:kworker.0 00000100:00100000:3.0:1787707282.749927:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707282.749994:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729732352 00000100:00100000:3.0:1787707282.749998:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729732352 00000100:00100000:3.0:1787707282.750032:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787707282.753274:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729732352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707282.753423:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729732352:12345-0@lo:400:kworker.0 Request processed in 3379us (4016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707282.753434:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787707282.765851:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729732480 00000100:00100000:1.0:1787707282.765868:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729732480 00000100:00100000:1.0:1787707282.765964:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787707282.765976:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729732480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707282.766074:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729732480:12345-0@lo:400:kworker.0 Request processed in 100us (16146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707282.766081:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787707282.767552:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729732096:0@lo:400:kworker.0 00000100:00100000:2.0:1787707282.767576:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787707282.767587:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729732608:0@lo:400:kworker.0 00000100:00100000:2.0:1787707282.767640:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707282.767698:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729732224:0@lo:400:kworker.0 00000100:00080000:3.0:1787707282.771723:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787707282.771734:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787707282.771790:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729732480:0@lo:400:kworker.0 00010000:00080000:3.0:1787707282.771810:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3fcbf800 x1874546729732352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707282.771822:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729732352:0@lo:400:kworker.0 00000100:00100000:0.0:1787707282.772274:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729732608 00000100:00100000:0.0:1787707282.772282:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729732608 00000100:00100000:0.0:1787707282.772350:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787707282.772361:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729732608:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787707282.772398:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787707282.772478:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729732608:12345-0@lo:400:kworker.0 Request processed in 118us (4837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707282.772486:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1787707282.772493:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3fcbed80 x1874546729732608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707282.772504:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729732608:0@lo:400:kworker.0 00000100:00100000:0.0:1787707283.257801:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2a5b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729732736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787707283.257879:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707283.257989:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729732736 00000100:00100000:3.0:1787707283.257997:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729732736 00000100:00100000:3.0:1787707283.258052:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787707283.258062:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729732736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787707283.258101:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707283.258146:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729732736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707283.258165:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1787707283.258243:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa2a5b9c00 x1874546729732736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707283.258261:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2a5b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729732736:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787707283.707579:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707284.355894:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707284.356231:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707284.356466:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707675520 00000100:00100000:3.0:1787707284.356478:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707675520 00000100:00080000:0.0:1787707284.356569:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787707284.356631:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707675648 00000100:00100000:1.0:1787707284.356636:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707675648 00000100:00100000:1.0:1787707284.356715:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 14 00000100:00100000:1.0:1787707284.356726:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2358:x1874546707675520:12345-192.168.204.46@tcp:9:kworker.0 00000020:00000080:1.0:1787707284.356756:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec09d1 00000100:00080000:1.0:1787707284.356767:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8cfa3cba9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787707284.356811:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787707284.357247:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+2:2358:x1874546707675520:12345-192.168.204.46@tcp:9:kworker.0 Request processed in 521us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707284.357255:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 14 00000100:00100000:1.0:1787707284.357272:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 15 00000100:00100000:1.0:1787707284.357279:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2358:x1874546707675648:12345-192.168.204.46@tcp:9:kworker.0 00000020:00000080:1.0:1787707284.357290:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec09d8 00000100:00080000:1.0:1787707284.357295:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8cfa3cbaf000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787707284.357317:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787707284.358087:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+2:2358:x1874546707675648:12345-192.168.204.46@tcp:9:kworker.0 Request processed in 804us (1852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707284.358106:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 15 00010000:00010000:1.0:1787707284.358125:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787707284.358215:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787707284.358291:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707284.358339:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707284.358443:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707284.358525:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707675136 00000100:00100000:0.0:1787707284.358532:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707675136 00000100:00100000:0.0:1787707284.358574:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 231 00000100:00100000:0.0:1787707284.358582:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+13:2360:x1874546707675136:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707284.358619:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+13:2360:x1874546707675136:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 38us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707284.358634:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 231 00010000:00010000:1.0:1787707284.358873:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707284.358885:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707675392 00000100:00100000:1.0:1787707284.358888:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707675392 00000100:00100000:1.0:1787707284.358993:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707675264 00000100:00100000:1.0:1787707284.358997:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707675264 00000100:00080000:0.0:1787707284.359020:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707284.359052:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 96 00000100:00100000:3.0:1787707284.359064:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2360:x1874546707675392:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707284.359171:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2360:x1874546707675392:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 111us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707284.359178:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 96 00000100:00100000:1.0:1787707284.359351:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 97 00000100:00100000:1.0:1787707284.359358:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2360:x1874546707675264:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707284.359414:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2360:x1874546707675264:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 56us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707284.359421:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 97 00010000:00010000:0.0:1787707284.728914:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787707285.408795:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 07fb5f38-6916-4d1b-963f-1397d7cf8aaf 00000020:00000080:3.0:1787707285.408804:0:7642:0:(genops.c:885:class_export_put()) final put ffff8cfa3cbac000/07fb5f38-6916-4d1b-963f-1397d7cf8aaf 00000020:00000080:0.0:1787707285.408864:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa3cbac000/07fb5f38-6916-4d1b-963f-1397d7cf8aaf for lustre-OST0001 00000020:00000080:0.0:1787707285.409101:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfa3cbaf000 for lustre-OST0001 00010000:00010000:1.0:1787707285.757272:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707285.816707:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2a5bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729732864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787707285.816801:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707285.817057:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729732864 00000100:00100000:3.0:1787707285.817065:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729732864 00000100:00100000:3.0:1787707285.817144:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787707285.817155:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729732864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787707285.817191:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707285.817239:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729732864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707285.817247:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1787707285.817786:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787707285.817816:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa2a5bb800 x1874546729732864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707285.817833:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2a5bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729732864:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787707286.777579:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707287.801099:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707287.865224:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729733120:0@lo:400:kworker.0 00000100:00100000:0.0:1787707287.865294:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707287.865342:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729733632:0@lo:400:kworker.0 00000100:00100000:0.0:1787707287.865367:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707287.865417:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787707287.865423:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729733248:0@lo:400:kworker.0 00000100:00100000:0.0:1787707287.865458:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707287.865492:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729733120 00000100:00100000:0.0:1787707287.865500:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729733120 00000100:00100000:0.0:1787707287.865539:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729733248 00000100:00100000:0.0:1787707287.865542:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729733248 00000100:00100000:0.0:1787707287.865568:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787707287.865576:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729733120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707287.865754:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729733120:12345-0@lo:400:kworker.0 Request processed in 177us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707287.865762:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787707287.865780:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787707287.865787:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729733248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707287.865817:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729733248:12345-0@lo:400:kworker.0 Request processed in 32us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707287.865824:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787707287.865875:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729733248:0@lo:400:kworker.0 00000100:00100000:0.0:1787707287.865884:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729733120:0@lo:400:kworker.0 00000100:00100000:3.0:1787707287.866189:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729733376:0@lo:400:kworker.0 00000100:00100000:3.0:1787707287.866237:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707287.866267:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787707287.866272:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729732992:0@lo:400:kworker.0 00000100:00100000:3.0:1787707287.866311:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707287.866336:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729733504:0@lo:400:kworker.0 00000100:00100000:3.0:1787707287.866357:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707287.866411:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729733504 00000100:00100000:3.0:1787707287.866415:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729733504 00000100:00100000:3.0:1787707287.866459:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787707287.866466:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729733504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707287.866502:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729733504:12345-0@lo:400:kworker.0 Request processed in 36us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707287.866508:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787707287.866526:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729733632 00000100:00100000:3.0:1787707287.866530:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729733632 00000100:00100000:3.0:1787707287.866555:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729733376 00000100:00100000:3.0:1787707287.866559:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729733376 00000100:00100000:3.0:1787707287.866580:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787707287.866586:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729733632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707287.866762:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729733632:12345-0@lo:400:kworker.0 Request processed in 37us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707287.866770:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787707287.866784:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787707287.866790:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729733376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707287.866821:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729733376:12345-0@lo:400:kworker.0 Request processed in 31us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707287.866826:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787707287.866849:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729732992 00000100:00100000:3.0:1787707287.866852:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729732992 00000100:00100000:3.0:1787707287.866876:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787707287.866889:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07314450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729732992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707287.866919:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07314450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729732992:12345-0@lo:400:kworker.0 Request processed in 32us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707287.866925:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787707287.867160:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729732992:0@lo:400:kworker.0 00000100:00100000:3.0:1787707287.867175:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729733504:0@lo:400:kworker.0 00010000:00080000:3.0:1787707287.867186:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3fcbce00 x1874546729733376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707287.867196:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729733376:0@lo:400:kworker.0 00000100:00080000:2.0:1787707287.867322:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787707287.867326:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787707287.867329:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787707287.867543:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3fcbc700 x1874546729733632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707287.867554:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729733632:0@lo:400:kworker.0 00000100:00100000:2.0:1787707288.392187:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729733760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787707288.392265:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707288.392347:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729733760 00000100:00100000:2.0:1787707288.392354:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729733760 00000100:00100000:2.0:1787707288.392461:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787707288.392471:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729733760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787707288.392507:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707288.392552:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729733760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707288.392559:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1787707288.392599:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41ca2300 x1874546729733760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707288.392618:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729733760:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787707288.824638:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707289.478439:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707289.478850:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707289.478877:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707289.484498:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707675776 00000100:00100000:1.0:1787707289.484512:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707675776 00000100:00100000:1.0:1787707289.484575:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 233 00000100:00100000:1.0:1787707289.484585:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07316850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:2361:x1874546707675776:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707289.484670:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07316850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:2361:x1874546707675776:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 86us (5820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707289.484679:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 233 00000100:00100000:1.0:1787707289.484725:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707675904 00000100:00100000:1.0:1787707289.484736:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707675904 00000100:00100000:1.0:1787707289.484779:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707676032 00000100:00100000:1.0:1787707289.484782:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707676032 00000100:00100000:1.0:1787707289.484802:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 101 00000100:00100000:1.0:1787707289.484808:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2361:x1874546707675904:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707289.484838:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2361:x1874546707675904:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 30us (6409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707289.484844:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 101 00000100:00100000:1.0:1787707289.484857:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 102 00000100:00100000:1.0:1787707289.484863:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2361:x1874546707676032:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707289.484886:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2361:x1874546707676032:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 24us (6009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707289.484892:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 102 00000100:00080000:2.0:1787707289.487082:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1787707289.522433:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 07fb5f38-6916-4d1b-963f-1397d7cf8aaf 00000020:00000080:0.0:1787707289.522442:0:6712:0:(genops.c:885:class_export_put()) final put ffff8cfa3cbaa800/07fb5f38-6916-4d1b-963f-1397d7cf8aaf 00000020:00000080:0.0:1787707289.522470:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa3cbaa800/07fb5f38-6916-4d1b-963f-1397d7cf8aaf for lustre-OST0000 00000020:00000080:0.0:1787707289.522510:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfa3cba9800 for lustre-OST0000 00010000:00010000:1.0:1787707289.851651:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707290.872562:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707290.946047:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2a5bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729733888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787707290.946120:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707290.949782:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729733888 00000100:00100000:2.0:1787707290.949796:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729733888 00000100:00100000:2.0:1787707290.949878:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787707290.949889:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729733888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787707290.951558:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787707290.952027:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787707290.963402:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729733888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 13479us (17246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707290.963417:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1787707290.963499:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa2a5bb100 x1874546729733888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707290.963527:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2a5bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729733888:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787707291.897556:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787707292.321737:0:11024:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787707292.921124:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707292.988954:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729734272:0@lo:400:kworker.0 00000100:00100000:1.0:1787707292.989042:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707292.989101:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787707292.989106:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729734144:0@lo:400:kworker.0 00000100:00100000:1.0:1787707292.989124:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707292.989139:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729734656:0@lo:400:kworker.0 00000100:00100000:1.0:1787707292.989330:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707292.989483:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729734272 00000100:00100000:1.0:1787707292.989491:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729734272 00000100:00100000:1.0:1787707292.989544:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729734144 00000100:00100000:1.0:1787707292.989547:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729734144 00000100:00100000:1.0:1787707292.989568:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787707292.989584:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729734272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707292.989640:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729734272:12345-0@lo:400:kworker.0 Request processed in 58us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707292.989648:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787707292.989666:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787707292.989672:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729734144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707292.989699:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729734144:12345-0@lo:400:kworker.0 Request processed in 27us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707292.989705:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787707292.989726:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729734656 00000100:00100000:1.0:1787707292.989729:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729734656 00000100:00100000:1.0:1787707292.989757:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787707292.989764:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729734656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707292.989794:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729734656:12345-0@lo:400:kworker.0 Request processed in 31us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707292.989800:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1787707292.989814:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787707292.989818:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787707292.989964:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729734144:0@lo:400:kworker.0 00010000:00080000:1.0:1787707292.989977:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41fd0a80 x1874546729734656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707292.990173:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729734016:0@lo:400:kworker.0 00000100:00100000:2.0:1787707292.990215:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707292.990242:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729734528:0@lo:400:kworker.0 00000100:00100000:2.0:1787707292.990265:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707292.990292:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787707292.990299:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729734400:0@lo:400:kworker.0 00000100:00100000:2.0:1787707292.990322:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707292.990348:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729734016 00000100:00100000:2.0:1787707292.990352:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729734016 00000100:00100000:2.0:1787707292.990400:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787707292.990407:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07314050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729734016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707292.990456:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07314050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729734016:12345-0@lo:400:kworker.0 Request processed in 50us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707292.990462:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787707292.990488:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729734400 00000100:00100000:2.0:1787707292.990492:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729734400 00000100:00100000:2.0:1787707292.990520:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787707292.990525:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729734400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707292.990551:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729734400:12345-0@lo:400:kworker.0 Request processed in 26us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707292.990556:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1787707292.990573:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787707292.990587:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41ca7800 x1874546729734400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707292.990597:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729734400:0@lo:400:kworker.0 00000100:00100000:2.0:1787707292.990605:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729734016:0@lo:400:kworker.0 00000100:00100000:2.0:1787707292.990646:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729734528 00000100:00100000:2.0:1787707292.990649:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729734528 00000100:00100000:2.0:1787707292.990675:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787707292.990681:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729734528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707292.990724:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729734528:12345-0@lo:400:kworker.0 Request processed in 42us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707292.990731:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1787707292.990747:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787707292.990763:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729734528:0@lo:400:kworker.0 00000100:00100000:1.0:1787707292.992431:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729734656:0@lo:400:kworker.0 00000100:00100000:1.0:1787707292.992467:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729734272:0@lo:400:kworker.0 00000100:00100000:2.0:1787707293.499329:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787707293.499351:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2a5b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729734784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787707293.499594:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707293.499742:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729734784 00000100:00100000:3.0:1787707293.499751:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729734784 00000100:00100000:3.0:1787707293.499802:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787707293.499817:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729734784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787707293.499853:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707293.499921:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729734784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707293.499929:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1787707293.500031:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa2a5b9c00 x1874546729734784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707293.500073:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2a5b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729734784:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787707293.948719:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707294.598912:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707294.598955:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707294.599001:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707294.599030:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707676288 00000100:00100000:3.0:1787707294.599040:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707676288 00000100:00100000:3.0:1787707294.599109:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707676416 00000100:00100000:3.0:1787707294.599113:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707676416 00000100:00100000:3.0:1787707294.599141:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 106 00000100:00100000:3.0:1787707294.599151:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2360:x1874546707676288:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707294.599233:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2360:x1874546707676288:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 84us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707294.599240:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 106 00000100:00100000:3.0:1787707294.599256:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 107 00000100:00100000:3.0:1787707294.599262:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2360:x1874546707676416:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707294.599284:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2360:x1874546707676416:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 23us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707294.599290:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 107 00000100:00080000:3.0:1787707294.599306:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707294.599704:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707676160 00000100:00100000:0.0:1787707294.599711:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707676160 00000100:00100000:0.0:1787707294.599759:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 235 00000100:00100000:0.0:1787707294.599767:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07316050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:2360:x1874546707676160:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707294.599800:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07316050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:2360:x1874546707676160:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 34us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707294.599806:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 235 00010000:00010000:1.0:1787707294.974715:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707295.992551:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707296.065513:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787707296.065544:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729734912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787707296.065643:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707296.066161:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729734912 00000100:00100000:3.0:1787707296.066170:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729734912 00000100:00100000:3.0:1787707296.066246:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787707296.066258:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729734912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787707296.066311:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707296.066367:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729734912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707296.066420:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1787707296.066464:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3ac53480 x1874546729734912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707296.066492:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729734912:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787707296.066719:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1787707296.706229:0:11173:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc38476ae0 20000000:00000080:3.0:1787707296.706248:0:11173:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cfa41999c00 uarg=0000000000000000 20000000:01000000:3.0:1787707296.706896:0:11173:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787707296.706903:0:11173:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787707296.706908:0:11173:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787707296.731125:0:11174:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1787707296.731501:0:11173:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787707296.745054:0:11173:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787707296.745088:0:11173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09df lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707296.745109:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa08746800/0xc5f18d5f94ec098b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0984 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707296.745116:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0999 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0992 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707296.745122:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa08746600/0xc5f18d5f94ec09a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec09a0 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707296.745131:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa3fcd2600/0xc5f18d5f94ec09ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9bd9 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707296.745137:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa00031200/0xc5f18d5f94ec09c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c11 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707296.745164:0:11173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09df lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707296.745218:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa00031200/0xc5f18d5f94ec09c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c11 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707296.745238:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfa00031200/0xc5f18d5f94ec09c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c11 expref: 12 pid: 5850 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707296.745255:0:11173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac53480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1874546729735040:192.168.204.46@tcp:104: 00010000:00010000:3.0:1787707296.745625:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa3fcd2600/0xc5f18d5f94ec09ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9bd9 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707296.745634:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfa3fcd2600/0xc5f18d5f94ec09ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9bd9 expref: 12 pid: 5851 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707296.745643:0:11173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac51c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1874546729735168:192.168.204.46@tcp:104: 00010000:00010000:3.0:1787707296.745681:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa08746600/0xc5f18d5f94ec09a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec09a0 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707296.745690:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa08746600/0xc5f18d5f94ec09a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec09a0 expref: 18 pid: 5848 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707296.745699:0:11173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac50e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1874546729735296:0@lo:104: 00000100:00100000:3.0:1787707296.745740:0:11173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787707296.745779:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0999 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec0992 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707296.745798:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0999 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0992 expref: 18 pid: 5850 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707296.745807:0:11173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac53100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1874546729735424:0@lo:104: 00000100:00100000:3.0:1787707296.745832:0:11173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787707296.745853:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa08746800/0xc5f18d5f94ec098b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec0984 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707296.745861:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa08746800/0xc5f18d5f94ec098b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0984 expref: 18 pid: 5850 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707296.745868:0:11173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac53b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1874546729735552:0@lo:104: 00000100:00100000:3.0:1787707296.745889:0:11173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707296.745900:0:11173:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1869d180 going to sleep for 11 seconds 00000100:00100000:2.0:1787707296.747331:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729735296 00000100:00100000:2.0:1787707296.747342:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729735296 00000100:00100000:2.0:1787707296.747411:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729735424 00000100:00100000:2.0:1787707296.747415:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729735424 00000100:00100000:2.0:1787707296.747427:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729735552 00000100:00100000:2.0:1787707296.747430:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729735552 00000100:00100000:2.0:1787707296.747445:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787707296.747457:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+5:11173:x1874546729735296:12345-0@lo:104: 00010000:00010000:2.0:1787707296.747478:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec09a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec09a7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707296.747578:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787707296.747584:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+5:11173:x1874546729735296:12345-0@lo:104: Request processed in 130us (1845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707296.747591:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787707296.747609:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787707296.747615:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+4:11173:x1874546729735424:12345-0@lo:104: 00010000:00010000:2.0:1787707296.747623:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0992 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0999 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707296.747676:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787707296.747682:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+4:11173:x1874546729735424:12345-0@lo:104: Request processed in 68us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707296.747689:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787707296.747702:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787707296.747708:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:11173:x1874546729735552:12345-0@lo:104: 00010000:00010000:2.0:1787707296.747716:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0984 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec098b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.747842:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787707296.747849:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec09a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec09a7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.747857:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3400 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:1.0:1787707296.747861:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec09a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec09a7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.747870:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec09a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec09a7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787707296.747878:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec09a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec09a7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707296.747884:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787707296.747916:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec09a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec09a7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.747935:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787707296.747960:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec09a0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec09a7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.747977:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec09a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec09a7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.747991:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787707296.747994:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0992 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0999 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.747999:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3e00 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:1.0:1787707296.748002:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0992 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec0999 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.748009:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec0999 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787707296.748015:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec0999 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707296.748020:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787707296.748035:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0992 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0999 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.748040:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787707296.748055:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0992 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0999 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.748061:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0992 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0999 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.748070:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707296.748080:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707296.748082:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707296.748099:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729735680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787707296.748143:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707296.748178:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729735808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787707296.748201:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707296.748234:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729735680 00000100:00100000:1.0:1787707296.748238:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729735680 00010000:00010000:1.0:1787707296.748259:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa08746600/0xc5f18d5f94ec09a7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec09a0 expref: 19 pid: 5848 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707296.748279:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729735808 00000100:00100000:1.0:1787707296.748282:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729735808 00010000:00010000:1.0:1787707296.748293:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0999 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0992 expref: 20 pid: 5850 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707296.748311:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787707296.748318:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa113cf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+20:3315:x1874546729735680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787707296.748328:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707296.748333:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa08746600/0xc5f18d5f94ec09a7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec09a0 expref: 20 pid: 5848 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.748342:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa08746600/0xc5f18d5f94ec09a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec09a0 expref: 20 pid: 5848 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.748360:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707296.748406:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa113cf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+20:3315:x1874546729735680:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707296.748412:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787707296.748461:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787707296.748467:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3316:x1874546729735808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787707296.748476:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707296.748481:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0999 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0992 expref: 19 pid: 5850 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.748489:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0999 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0992 expref: 19 pid: 5850 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.748499:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707296.748525:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3316:x1874546729735808:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707296.748531:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787707296.748568:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729735680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787707296.748592:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729735808:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787707296.748665:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707296.749195:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787707296.749204:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:11173:x1874546729735552:12345-0@lo:104: Request processed in 1495us (3313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707296.749212:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787707296.751648:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787707296.751665:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0984 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec098b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.751677:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2200 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:1.0:1787707296.751681:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0984 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec098b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.751692:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0984 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec098b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787707296.751700:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0984 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec098b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707296.751741:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787707296.751816:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0984 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec098b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.751822:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787707296.751860:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0984 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec098b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.751867:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0984 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec098b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.751892:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707296.751894:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707296.751896:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707296.751906:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787707296.752017:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729735936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787707296.752092:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707296.752153:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729735936 00000100:00100000:1.0:1787707296.752160:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729735936 00010000:00010000:1.0:1787707296.752189:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa08746800/0xc5f18d5f94ec098b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0984 expref: 19 pid: 5850 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707296.752216:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787707296.752224:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3316:x1874546729735936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787707296.752237:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707296.752242:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa08746800/0xc5f18d5f94ec098b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0984 expref: 19 pid: 5850 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.752253:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa08746800/0xc5f18d5f94ec098b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0984 expref: 19 pid: 5850 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707296.752702:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707296.752811:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3316:x1874546729735936:12345-0@lo:103:ldlm_bl.0 Request processed in 586us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707296.752819:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787707296.755210:0:11173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa08746600/0xc5f18d5f94ec09a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec09a0 expref: 18 pid: 5848 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707296.755232:0:11173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac50e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1874546729735296:0@lo:104: 00010000:00010000:3.0:1787707296.755246:0:11173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0999 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec0992 expref: 17 pid: 5850 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707296.755255:0:11173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac53100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1874546729735424:0@lo:104: 00010000:00010000:3.0:1787707296.755277:0:11173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa08746800/0xc5f18d5f94ec098b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec0984 expref: 16 pid: 5850 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707296.755540:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707296.755589:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707296.755620:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707676544 00000100:00100000:2.0:1787707296.755630:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707676544 00010000:00010000:2.0:1787707296.755666:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa00031200/0xc5f18d5f94ec09c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c11 expref: 13 pid: 5850 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707296.755693:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707676672 00000100:00100000:2.0:1787707296.755696:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707676672 00010000:00010000:2.0:1787707296.755707:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa3fcd2600/0xc5f18d5f94ec09ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9bd9 expref: 14 pid: 5851 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707296.755727:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 28 00000100:00100000:2.0:1787707296.755751:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60f5ae37-220d-45d9-b012-b91715df156e+14:2361:x1874546707676544:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787707296.755784:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707296.755792:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa00031200/0xc5f18d5f94ec09c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c11 expref: 14 pid: 5850 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707296.755817:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa00031200/0xc5f18d5f94ec09c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c11 expref: 14 pid: 5850 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707296.755842:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707296.755900:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60f5ae37-220d-45d9-b012-b91715df156e+14:2361:x1874546707676544:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 149us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707296.755908:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 28 00000100:00100000:2.0:1787707296.755939:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 29 00000100:00100000:2.0:1787707296.755947:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60f5ae37-220d-45d9-b012-b91715df156e+13:2361:x1874546707676672:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787707296.755955:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707296.755960:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa3fcd2600/0xc5f18d5f94ec09ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9bd9 expref: 13 pid: 5851 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707296.755969:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa3fcd2600/0xc5f18d5f94ec09ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9bd9 expref: 13 pid: 5851 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707296.755982:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09df lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707296.755990:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09df lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707296.756006:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09df lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707296.756024:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09df lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707296.756032:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09df lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707296.756038:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09df lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707296.756045:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa00031c00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707296.756050:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09df lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707296.756058:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09df lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707296.756068:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09df lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707296.756079:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707296.756100:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60f5ae37-220d-45d9-b012-b91715df156e+13:2361:x1874546707676672:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 154us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707296.756108:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 29 00000100:00100000:3.0:1787707296.757669:0:11173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac53b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1874546729735552:0@lo:104: 00010000:00010000:3.0:1787707296.759602:0:11173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa00031200/0xc5f18d5f94ec09c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c11 expref: 12 pid: 5850 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707296.759650:0:11173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac53480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1874546729735040:192.168.204.46@tcp:104: 00010000:00010000:3.0:1787707296.759678:0:11173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa3fcd2600/0xc5f18d5f94ec09ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9bd9 expref: 11 pid: 5851 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707296.759687:0:11173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac51c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1874546729735168:192.168.204.46@tcp:104: 00010000:00010000:3.0:1787707296.759722:0:11173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09df lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707296.759927:0:11173:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09df lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707296.759936:0:11173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09df lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707296.759943:0:11173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09df lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707296.762766:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729735936:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787707297.016569:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707298.041676:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707298.104670:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729736192:0@lo:400:kworker.0 00000100:00100000:1.0:1787707298.104743:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707298.104796:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729736704:0@lo:400:kworker.0 00000100:00100000:1.0:1787707298.104824:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707298.104856:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787707298.104863:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729736064:0@lo:400:kworker.0 00000100:00100000:1.0:1787707298.104891:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707298.104926:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729736576:0@lo:400:kworker.0 00000100:00100000:1.0:1787707298.104951:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707298.104977:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729736320:0@lo:400:kworker.0 00000100:00100000:1.0:1787707298.104999:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707298.105015:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787707298.105020:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729736448:0@lo:400:kworker.0 00000100:00100000:1.0:1787707298.105039:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707298.105070:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729736704 00000100:00100000:1.0:1787707298.105077:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729736704 00000100:00100000:1.0:1787707298.105144:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729736448 00000100:00100000:1.0:1787707298.105148:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729736448 00000100:00100000:1.0:1787707298.105172:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787707298.105180:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729736704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707298.105230:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729736704:12345-0@lo:400:kworker.0 Request processed in 50us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707298.105248:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787707298.105266:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787707298.105273:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729736448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707298.105310:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729736448:12345-0@lo:400:kworker.0 Request processed in 37us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707298.105316:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787707298.105334:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729736064 00000100:00100000:1.0:1787707298.105337:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729736064 00000100:00100000:1.0:1787707298.105399:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787707298.105406:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:3315:x1874546729736064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707298.105434:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:3315:x1874546729736064:12345-0@lo:400:kworker.0 Request processed in 30us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707298.105440:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00080000:1.0:1787707298.105466:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787707298.105470:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787707298.105500:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41a05500 x1874546729736448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707298.105512:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729736448:0@lo:400:kworker.0 00000100:00100000:1.0:1787707298.105535:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729736064:0@lo:400:kworker.0 00010000:00080000:1.0:1787707298.105544:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41a06680 x1874546729736704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707298.105552:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729736704:0@lo:400:kworker.0 00000100:00100000:3.0:1787707298.106245:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729736192 00000100:00100000:3.0:1787707298.106252:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729736192 00000100:00100000:3.0:1787707298.106291:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729736576 00000100:00100000:3.0:1787707298.106295:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729736576 00000100:00100000:3.0:1787707298.106316:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729736320 00000100:00100000:3.0:1787707298.106320:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729736320 00000100:00100000:3.0:1787707298.106336:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787707298.106344:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729736192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707298.106428:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729736192:12345-0@lo:400:kworker.0 Request processed in 85us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707298.106444:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787707298.106460:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787707298.106467:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729736576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707298.106498:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729736576:12345-0@lo:400:kworker.0 Request processed in 32us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707298.106505:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787707298.106517:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787707298.106523:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729736320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707298.106553:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729736320:12345-0@lo:400:kworker.0 Request processed in 31us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707298.106559:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1787707298.106583:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707298.106611:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729736576:0@lo:400:kworker.0 00000100:00100000:3.0:1787707298.106622:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729736192:0@lo:400:kworker.0 00000100:00100000:1.0:1787707298.107513:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729736320:0@lo:400:kworker.0 00000100:00100000:2.0:1787707298.434355:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707298.434679:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707676800 00000100:00100000:3.0:1787707298.434694:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707676800 00000100:00100000:3.0:1787707298.434788:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 237 00000100:00100000:3.0:1787707298.434801:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+11:5602:x1874546707676800:12345-192.168.204.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787707298.434824:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707298.434855:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9c3b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707298.434910:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c3b expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707298.434955:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c3b expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707298.434968:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa00031c00, rc 0) 00000100:00100000:3.0:1787707298.435052:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+12:5602:x1874546707676800:12345-192.168.204.46@tcp:101:ll_cfg_requeue.0 Request processed in 253us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707298.435059:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 237 00000100:00100000:2.0:1787707298.439522:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707298.439642:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707676928 00000100:00100000:1.0:1787707298.439664:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707676928 00000100:00100000:1.0:1787707298.439730:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 238 00000100:00100000:1.0:1787707298.439742:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07314850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+12:5602:x1874546707676928:12345-192.168.204.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787707298.440121:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07314850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+12:5602:x1874546707676928:12345-192.168.204.46@tcp:501:ll_cfg_requeue.0 Request processed in 379us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707298.440130:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 238 00000100:00100000:2.0:1787707298.443281:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707298.443443:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707677056 00000100:00100000:3.0:1787707298.443456:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707677056 00000100:00100000:3.0:1787707298.443623:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 239 00000100:00100000:3.0:1787707298.443637:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07316450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+12:5602:x1874546707677056:12345-192.168.204.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787707298.443979:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07316450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+12:5602:x1874546707677056:12345-192.168.204.46@tcp:503:ll_cfg_requeue.0 Request processed in 344us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707298.443988:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 239 00000100:00100000:2.0:1787707298.450157:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707298.451154:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707677184 00000100:00100000:1.0:1787707298.451170:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707677184 00000100:00100000:1.0:1787707298.451441:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 240 00000100:00100000:1.0:1787707298.451455:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07315050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+12:5602:x1874546707677184:12345-192.168.204.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787707298.451479:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707298.451504:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa029d4000/0xc5f18d5f94ec09ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9c42 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707298.451544:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa029d4000/0xc5f18d5f94ec09ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c42 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707298.451557:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa029d4000/0xc5f18d5f94ec09ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c42 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707298.451568:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d4000, rc 0) 00000100:00100000:1.0:1787707298.451653:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07315050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:5602:x1874546707677184:12345-192.168.204.46@tcp:101:ll_cfg_requeue.0 Request processed in 201us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707298.451660:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 240 00000100:00100000:0.0:1787707298.454411:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707298.454568:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707677312 00000100:00100000:1.0:1787707298.454582:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707677312 00000100:00100000:1.0:1787707298.454693:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 241 00000100:00100000:1.0:1787707298.454706:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07315850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:5602:x1874546707677312:12345-192.168.204.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787707298.455161:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07315850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:5602:x1874546707677312:12345-192.168.204.46@tcp:501:ll_cfg_requeue.0 Request processed in 456us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707298.455171:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 241 00000100:00100000:2.0:1787707298.459168:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707298.459257:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707677440 00000100:00100000:0.0:1787707298.459270:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707677440 00000100:00100000:0.0:1787707298.459341:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 242 00000100:00100000:0.0:1787707298.459355:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:5602:x1874546707677440:12345-192.168.204.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787707298.459804:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:5602:x1874546707677440:12345-192.168.204.46@tcp:503:ll_cfg_requeue.0 Request processed in 450us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707298.459813:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 242 10000000:01000000:2.0:1787707298.556630:0:5853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787707298.556651:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfa3f9b5800 from 7 10000000:01000000:2.0:1787707298.556657:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787707298.556720:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa08746400/0xc5f18d5f94ec09f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707298.556735:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa08746400/0xc5f18d5f94ec09f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707298.556750:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa08746400/0xc5f18d5f94ec09f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707298.556796:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729736832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787707298.556904:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707298.556976:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05edb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787707298.557824:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729736832 00000100:00100000:3.0:1787707298.557836:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729736832 00000100:00100000:3.0:1787707298.557923:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787707298.557936:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:5853:x1874546729736832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787707298.557954:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707298.557974:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa00031200/0xc5f18d5f94ec09fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec09f4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707298.558009:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa00031200/0xc5f18d5f94ec09fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec09f4 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707298.558020:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa00031200/0xc5f18d5f94ec09fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec09f4 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707298.558045:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa00031200, rc 0) 00000100:00100000:3.0:1787707298.558119:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729736832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707298.558127:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787707298.571077:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729736832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787707298.571117:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa08746400/0xc5f18d5f94ec09f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec09fb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707298.571132:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa08746400/0xc5f18d5f94ec09f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec09fb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707298.571243:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729736960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787707298.571331:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707298.571409:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05edb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787707298.571434:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729736960 00000100:00100000:2.0:1787707298.571442:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729736960 00000100:00100000:2.0:1787707298.571494:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787707298.572229:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729736960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787707298.572872:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729736960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1365us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707298.572901:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787707298.575039:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729736960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787707298.575141:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac51c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729737088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787707298.575237:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707298.575293:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa14725a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787707298.575517:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729737088 00000100:00100000:2.0:1787707298.575527:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729737088 00000100:00100000:2.0:1787707298.575585:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787707298.575596:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729737088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787707298.575841:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729737088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707298.575850:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787707298.577001:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac51c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729737088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787707298.581318:0:11200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787707298.581683:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787707298.581724:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787707298.581740:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa08746400/0xc5f18d5f94ec09f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec09fb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707298.581756:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa08746400/0xc5f18d5f94ec09f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec09fb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707298.581778:0:5853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787707298.581781:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfa34ab9800 from 7 10000000:01000000:2.0:1787707298.581784:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787707298.581842:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa08746c00/0xc5f18d5f94ec0a02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707298.581850:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa08746c00/0xc5f18d5f94ec0a02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707298.581865:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa08746c00/0xc5f18d5f94ec0a02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707298.581913:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729737216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787707298.582030:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707298.582098:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05edb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787707298.582222:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729737216 00000100:00100000:3.0:1787707298.582233:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729737216 00000100:00100000:3.0:1787707298.582294:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787707298.582306:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729737216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787707298.582323:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707298.582340:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa00030800/0xc5f18d5f94ec0a09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0a02 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707298.582402:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa00030800/0xc5f18d5f94ec0a09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0a02 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707298.582416:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa00030800/0xc5f18d5f94ec0a09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0a02 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707298.582427:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa00030800, rc 0) 00000100:00100000:3.0:1787707298.582481:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729737216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707298.582499:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787707298.582667:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729737216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787707298.582685:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa08746c00/0xc5f18d5f94ec0a02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0a09 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707298.582696:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa08746c00/0xc5f18d5f94ec0a02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0a09 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707298.582833:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729737344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787707298.582866:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707298.582900:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05edb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787707298.583642:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729737344 00000100:00100000:3.0:1787707298.583652:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729737344 00000100:00100000:3.0:1787707298.583699:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787707298.583708:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729737344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787707298.587107:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729737344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3386us (4226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707298.587123:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787707298.588218:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729737344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787707298.588305:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729737472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787707298.588407:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707298.588463:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05edb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787707298.588554:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729737472 00000100:00100000:3.0:1787707298.588563:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729737472 00000100:00100000:3.0:1787707298.588619:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787707298.588631:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729737472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787707298.589060:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729737472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 430us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707298.589069:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787707298.601261:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729737472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787707298.603402:0:11203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787707298.603626:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787707298.603650:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787707298.603665:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa08746c00/0xc5f18d5f94ec0a02 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0a09 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707298.603680:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa08746c00/0xc5f18d5f94ec0a02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0a09 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707298.603692:0:5853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787707298.603712:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfa02b55800 from 7 10000000:01000000:2.0:1787707298.603716:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787707298.603760:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa08746800/0xc5f18d5f94ec0a10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707298.603835:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa08746800/0xc5f18d5f94ec0a10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707298.603849:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa08746800/0xc5f18d5f94ec0a10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707298.603882:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729737600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787707298.603980:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707298.604040:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05edb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707298.605099:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729737600 00000100:00100000:1.0:1787707298.605116:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729737600 00000100:00100000:1.0:1787707298.605196:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787707298.605207:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729737600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787707298.605226:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707298.605249:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0a17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0a10 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707298.605285:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0a17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0a10 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707298.605298:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0a17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0a10 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707298.605309:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d5e00, rc 0) 00000100:00100000:1.0:1787707298.605403:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:5853:x1874546729737600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707298.605410:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787707298.605895:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729737600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787707298.605918:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa08746800/0xc5f18d5f94ec0a10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0a17 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707298.605930:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa08746800/0xc5f18d5f94ec0a10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0a17 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707298.606023:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729737728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787707298.606064:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707298.606135:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05edb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787707298.608859:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729737728 00000100:00100000:3.0:1787707298.608965:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729737728 00000100:00100000:3.0:1787707298.609040:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787707298.609053:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:5853:x1874546729737728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787707298.609794:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:5853:x1874546729737728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 742us (3727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707298.609804:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787707298.609877:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729737728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787707298.609962:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729737856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787707298.610023:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707298.610068:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1869d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787707298.610240:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729737856 00000100:00100000:3.0:1787707298.610247:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729737856 00000100:00100000:3.0:1787707298.610287:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787707298.610297:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:5853:x1874546729737856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787707298.610721:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:5853:x1874546729737856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 425us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707298.610729:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787707298.610869:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729737856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787707298.616534:0:11204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787707298.616785:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787707298.616810:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787707298.616824:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa08746800/0xc5f18d5f94ec0a10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0a17 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707298.616866:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa08746800/0xc5f18d5f94ec0a10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0a17 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707298.617058:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787707298.617085:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729737984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787707298.617178:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707298.619466:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729737984 00000100:00100000:2.0:1787707298.619488:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729737984 00000100:00100000:2.0:1787707298.619584:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787707298.619599:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729737984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787707298.619652:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707298.619789:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729737984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 193us (2610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707298.619797:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1787707298.621991:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3fcbc380 x1874546729737984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707298.622027:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729737984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787707299.064874:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707299.716123:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707299.716268:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707677568 00000100:00100000:3.0:1787707299.716283:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707677568 00000100:00100000:3.0:1787707299.716364:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 252 00000100:00100000:3.0:1787707299.716421:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:2359:x1874546707677568:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707299.716522:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:2359:x1874546707677568:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 109us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707299.716530:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 252 00000100:00100000:2.0:1787707299.722364:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707299.722440:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707299.722484:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707677696 00000100:00100000:2.0:1787707299.722498:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707677696 00000100:00100000:2.0:1787707299.722569:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707677824 00000100:00100000:2.0:1787707299.722572:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707677824 00000100:00100000:2.0:1787707299.722604:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 111 00000100:00100000:2.0:1787707299.722616:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2359:x1874546707677696:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707299.722704:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2359:x1874546707677696:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 91us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707299.722712:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 111 00000100:00100000:2.0:1787707299.722732:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 112 00000100:00100000:2.0:1787707299.722740:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2359:x1874546707677824:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707299.722767:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2359:x1874546707677824:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 27us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707299.722773:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 112 00000100:00080000:2.0:1787707299.722792:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787707300.090128:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707301.113261:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707301.180068:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787707301.180092:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729738112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787707301.180165:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707301.180243:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729738112 00000100:00100000:2.0:1787707301.180251:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729738112 00000100:00080000:3.0:1787707301.180299:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787707301.180304:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787707301.180313:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729738112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787707301.180682:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707301.180866:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729738112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 552us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707301.180874:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1787707301.181472:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa41ca5500 x1874546729738112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707301.181494:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729738112:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787707302.004039:0:11371:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg446-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787707302.136528:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707303.160623:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707303.229848:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729738624:0@lo:400:kworker.0 00000100:00100000:3.0:1787707303.229908:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729738368:0@lo:400:kworker.0 00000100:00100000:0.0:1787707303.229923:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707303.229984:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729738240:0@lo:400:kworker.0 00000100:00100000:1.0:1787707303.229995:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729738496:0@lo:400:kworker.0 00000100:00100000:3.0:1787707303.231615:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707303.231902:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729738880:0@lo:400:kworker.0 00000100:00100000:3.0:1787707303.231940:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707303.232000:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729738368 00000100:00100000:3.0:1787707303.232009:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729738368 00000100:00100000:3.0:1787707303.232062:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787707303.232071:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729738368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707303.232118:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729738368:12345-0@lo:400:kworker.0 Request processed in 48us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707303.232136:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787707303.232178:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729738368:0@lo:400:kworker.0 00000100:00100000:3.0:1787707303.232215:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729738624 00000100:00100000:3.0:1787707303.232218:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729738624 00000100:00100000:3.0:1787707303.232246:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729738880 00000100:00100000:3.0:1787707303.232248:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729738880 00000100:00100000:3.0:1787707303.232264:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787707303.232270:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729738624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707303.232300:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729738624:12345-0@lo:400:kworker.0 Request processed in 31us (2380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707303.232307:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787707303.232316:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787707303.232321:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729738880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707303.232345:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729738880:12345-0@lo:400:kworker.0 Request processed in 24us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707303.232351:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1787707303.232362:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787707303.232365:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787707303.232401:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3fcbea00 x1874546729738880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707303.232412:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729738880:0@lo:400:kworker.0 00000100:00100000:2.0:1787707303.232524:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707303.232556:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729738752:0@lo:400:kworker.0 00000100:00100000:2.0:1787707303.232578:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707303.232606:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729738752 00000100:00100000:2.0:1787707303.232610:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729738752 00000100:00100000:2.0:1787707303.232655:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787707303.232662:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729738752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707303.232945:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729738752:12345-0@lo:400:kworker.0 Request processed in 282us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707303.232952:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787707303.232983:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729738752:0@lo:400:kworker.0 00000100:00100000:3.0:1787707303.233079:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729738240 00000100:00100000:3.0:1787707303.233084:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729738240 00000100:00100000:3.0:1787707303.233162:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787707303.233170:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729738240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707303.233223:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729738240:12345-0@lo:400:kworker.0 Request processed in 54us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707303.233229:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00010000:00080000:0.0:1787707303.237000:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3fcbc700 x1874546729738624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707303.237019:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729738624:0@lo:400:kworker.0 00000100:00080000:0.0:1787707303.237100:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707303.237135:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729738240:0@lo:400:kworker.0 00000100:00100000:1.0:1787707303.237846:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707303.241412:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729738496 00000100:00100000:0.0:1787707303.241428:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729738496 00000100:00100000:0.0:1787707303.241539:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787707303.241550:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729738496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707303.241660:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729738496:12345-0@lo:400:kworker.0 Request processed in 113us (3815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707303.241668:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787707303.242091:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729738496:0@lo:400:kworker.0 00000100:00080000:3.0:1787707303.242103:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707303.737345:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787707303.737408:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729739008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787707303.737497:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707303.739479:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729739008 00000100:00100000:2.0:1787707303.739496:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729739008 00000100:00100000:2.0:1787707303.739585:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787707303.739599:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729739008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787707303.739651:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707303.739738:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729739008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (2240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707303.739745:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1787707303.739923:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3fcbc380 x1874546729739008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707303.739963:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729739008:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787707304.184574:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707304.836963:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707304.837019:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707304.837061:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707304.837149:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707678208 00000100:00100000:3.0:1787707304.837169:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707678208 00000100:00100000:1.0:1787707304.837182:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707678080 00000100:00100000:1.0:1787707304.837194:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707678080 00000100:00080000:2.0:1787707304.837291:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707304.837295:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 116 00000100:00100000:3.0:1787707304.837318:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2359:x1874546707678208:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707304.837477:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707677952 00000100:00100000:3.0:1787707304.837484:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2359:x1874546707678208:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 169us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707304.837487:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707677952 00000100:00100000:3.0:1787707304.837502:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 116 00000100:00100000:3.0:1787707304.837533:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 117 00000100:00100000:3.0:1787707304.837546:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2359:x1874546707678080:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707304.837556:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 254 00000100:00100000:0.0:1787707304.837577:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:2359:x1874546707677952:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707304.837588:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2359:x1874546707678080:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 41us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707304.837599:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 117 00000100:00100000:0.0:1787707304.841998:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:2359:x1874546707677952:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 4415us (5032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707304.842015:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 254 00010000:00010000:1.0:1787707305.208508:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787707305.961873:0:11472:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 21:21:43 (1787707303) === 00010000:00010000:1.0:1787707306.235071:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707306.298890:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787707306.298917:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729739136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787707306.298992:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707306.299146:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729739136 00000100:00100000:3.0:1787707306.299155:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729739136 00000100:00100000:3.0:1787707306.299226:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787707306.299236:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729739136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787707306.299269:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707306.299319:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729739136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707306.299327:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1787707306.299403:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3ac53100 x1874546729739136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707306.299438:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729739136:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787707306.299622:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787707306.347809:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707306.347931:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707306.347971:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707678336 00000100:00100000:0.0:1787707306.347981:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707678336 00000100:00100000:0.0:1787707306.348063:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 14 00000100:00100000:0.0:1787707306.348074:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2359:x1874546707678336:12345-192.168.204.46@tcp:41:mkdir.0 00000004:00000024:0.0:1787707306.348117:0:5858:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1787707306.348181:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707306.348219:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2359:x1874546707678336:12345-192.168.204.46@tcp:41:mkdir.0 Request processed in 146us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707306.348233:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 14 00000100:00100000:1.0:1787707306.348312:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707678464 00000100:00100000:1.0:1787707306.348317:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707678464 00000100:00100000:1.0:1787707306.348349:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 0 00000100:00100000:1.0:1787707306.348357:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:9716:x1874546707678464:12345-192.168.204.46@tcp:700:mkdir.0 00000100:00100000:1.0:1787707306.348429:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:9716:x1874546707678464:12345-192.168.204.46@tcp:700:mkdir.0 Request processed in 73us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707306.348436:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 0 00000100:00100000:2.0:1787707306.353072:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707306.353228:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707678720 00000100:00100000:3.0:1787707306.353239:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707678720 00000100:00100000:3.0:1787707306.353300:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 15 00000100:00100000:3.0:1787707306.353310:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:9716:x1874546707678720:12345-192.168.204.46@tcp:36:mkdir.0 00010000:00010000:3.0:1787707306.353421:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707306.353504:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec08ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9bc4 expref: 6 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.353524:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa143e4d00) 00010000:00010000:3.0:1787707306.353535:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787707306.354023:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0a1e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.354037:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0a1e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.354048:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0a1e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.354080:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0a25 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.354088:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0a25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.354095:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0a25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707306.355350:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787707306.355365:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0a1e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.355403:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0a1e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.355410:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0a1e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.355416:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707306.355422:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0a1e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.355436:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0a1e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.355451:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa19f4ed00) 00010000:00010000:0.0:1787707306.355454:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707306.355458:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0a1e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.355464:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0a1e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787707306.355480:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000791bb80 reply state 000000009ef1f0e4 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0a25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707306.355488:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787707306.355816:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+7:9716:x1874546707678720:12345-192.168.204.46@tcp:36:mkdir.0 Request processed in 2503us (2751us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787707306.355825:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 15 00010000:00010000:3.0:1787707306.366036:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0a25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.366062:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0a25 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.366071:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0a25 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.366086:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707306.366091:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0a25 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.366098:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0a25 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.366115:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cfa19f4e600) 00010000:00010000:3.0:1787707306.366131:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707306.366136:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0a25 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.366142:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0a25 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707306.381790:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707306.382233:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707678848 00000100:00100000:0.0:1787707306.382245:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707678848 00000100:00100000:0.0:1787707306.382301:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 16 00000100:00100000:0.0:1787707306.382312:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:9717:x1874546707678848:12345-192.168.204.46@tcp:101:chmod.0 00010000:00010000:0.0:1787707306.382333:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707306.382357:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0a2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9c49 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.382436:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0a33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.382464:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0a33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.382474:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0a33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707306.382546:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787707306.382551:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787707306.382592:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0a33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.382631:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0a2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c49 expref: 8 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.382649:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0a33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c49 expref: 7 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.382657:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa19f4ed00) 00010000:00010000:0.0:1787707306.382660:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787707306.382664:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2200, rc 0) 00000100:00100000:0.0:1787707306.382731:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+7:9717:x1874546707678848:12345-192.168.204.46@tcp:101:chmod.0 Request processed in 421us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707306.382748:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 16 00000100:00100000:2.0:1787707306.415713:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707306.415933:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707679104 00000100:00100000:3.0:1787707306.415945:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707679104 00000100:00100000:3.0:1787707306.416056:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 17 00000100:00100000:3.0:1787707306.416068:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+7:9717:x1874546707679104:12345-192.168.204.46@tcp:36:chmod.0 00010000:00010000:3.0:1787707306.416141:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707306.416168:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0a33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c49 expref: 7 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.416187:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa19f4ed00) 00010000:00010000:3.0:1787707306.416198:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787707306.416223:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0a3a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.416235:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0a3a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.416244:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0a3a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787707306.418253:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000987a1a90 reply state 00000000a83ea722 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0a3a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707306.418270:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787707306.418293:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787707306.418419:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+8:9717:x1874546707679104:12345-192.168.204.46@tcp:36:chmod.0 Request processed in 2351us (2715us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787707306.418428:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 17 00010000:00010000:0.0:1787707306.421880:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0a3a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.421896:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0a3a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.421928:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0a3a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.421935:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707306.421939:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0a3a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.421947:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0a3a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.421963:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa143e4d00) 00010000:00010000:0.0:1787707306.421966:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787707306.421971:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0a3a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.421977:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0a3a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707306.478678:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707306.484840:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707679232 00000100:00100000:0.0:1787707306.484858:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707679232 00000100:00100000:2.0:1787707306.485109:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 18 00000100:00100000:2.0:1787707306.485122:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+7:9718:x1874546707679232:12345-192.168.204.46@tcp:101:chown.0 00010000:00010000:2.0:1787707306.485158:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707306.485187:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747200/0xc5f18d5f94ec0a41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9c50 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.485276:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08746600/0xc5f18d5f94ec0a48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.485289:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08746600/0xc5f18d5f94ec0a48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.485300:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08746600/0xc5f18d5f94ec0a48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707306.485364:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787707306.485389:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787707306.485431:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08746600/0xc5f18d5f94ec0a48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.485457:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747200/0xc5f18d5f94ec0a41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c50 expref: 9 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.485477:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08746600/0xc5f18d5f94ec0a48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c50 expref: 8 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.485486:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:2.0:1787707306.485489:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787707306.485491:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa08746600, rc 0) 00000100:00100000:2.0:1787707306.485572:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+8:9718:x1874546707679232:12345-192.168.204.46@tcp:101:chown.0 Request processed in 452us (6957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707306.485580:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 18 00000100:00100000:3.0:1787707306.491206:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707306.491308:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707679360 00000100:00100000:0.0:1787707306.491318:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707679360 00000100:00100000:0.0:1787707306.491406:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 19 00000100:00100000:0.0:1787707306.491467:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+8:9718:x1874546707679360:12345-192.168.204.46@tcp:101:chown.0 00010000:00010000:0.0:1787707306.491487:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707306.491518:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0a4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9c57 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491591:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0a56 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491630:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0a56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491640:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0a56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491654:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0a5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491661:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0a5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491667:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0a5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491772:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec0a64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491781:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec0a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491788:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec0a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707306.491823:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787707306.491826:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787707306.491851:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec0a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491862:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0a56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491883:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0a56 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491888:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0a56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491894:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707306.491898:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0a56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491906:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0a56 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491918:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:0.0:1787707306.491921:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707306.491925:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0a56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491932:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0a56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491944:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0a5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491950:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0a5d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491956:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0a5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491961:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707306.491970:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0a5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491976:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0a5d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491984:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cfa19f4e200) 00010000:00010000:0.0:1787707306.491986:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707306.491989:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0a5d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.491994:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0a5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.492025:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0a4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c57 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.492038:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec0a64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c57 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.492045:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cfa19f4e300) 00010000:00010000:0.0:1787707306.492048:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787707306.492050:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3200, rc 0) 00000100:00100000:0.0:1787707306.492115:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+9:9718:x1874546707679360:12345-192.168.204.46@tcp:101:chown.0 Request processed in 700us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707306.493154:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 19 00000100:00100000:0.0:1787707306.497996:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707306.498726:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707679616 00000100:00100000:2.0:1787707306.498753:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707679616 00000100:00100000:2.0:1787707306.498834:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 20 00000100:00100000:2.0:1787707306.498845:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+9:9718:x1874546707679616:12345-192.168.204.46@tcp:36:chown.0 00010000:00010000:2.0:1787707306.498914:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707306.498942:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec0a64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c57 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.498961:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cfa19f4e300) 00010000:00010000:2.0:1787707306.498972:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787707306.498998:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747200/0xc5f18d5f94ec0a6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.499011:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747200/0xc5f18d5f94ec0a6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.499021:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747200/0xc5f18d5f94ec0a6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787707306.538163:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000775b02b9 reply state 00000000b4a8bcf9 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747200/0xc5f18d5f94ec0a6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707306.538182:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787707306.538364:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787707306.538511:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+10:9718:x1874546707679616:12345-192.168.204.46@tcp:36:chown.0 Request processed in 39663us (40520us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787707306.538521:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 20 00000001:00080000:1.0:1787707306.538812:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:1.0:1787707306.538840:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:2.0:1787707306.539237:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747200/0xc5f18d5f94ec0a6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.539249:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747200/0xc5f18d5f94ec0a6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.539270:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747200/0xc5f18d5f94ec0a6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.539277:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa08747200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707306.539281:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747200/0xc5f18d5f94ec0a6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.539288:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747200/0xc5f18d5f94ec0a6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.539304:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:2.0:1787707306.539307:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787707306.539312:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747200/0xc5f18d5f94ec0a6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.539318:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747200/0xc5f18d5f94ec0a6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707306.569207:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707306.569584:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707679744 00000100:00100000:2.0:1787707306.569597:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707679744 00000100:00100000:2.0:1787707306.569673:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 21 00000100:00100000:2.0:1787707306.569684:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:9719:x1874546707679744:12345-192.168.204.46@tcp:101:touch.500 00010000:00010000:2.0:1787707306.569708:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707306.569729:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747200/0xc5f18d5f94ec0a72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9c5e expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787707306.579707:0:5856:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 9914us 00010000:00010000:2.0:1787707306.608834:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747800/0xc5f18d5f94ec0a79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.608866:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747800/0xc5f18d5f94ec0a79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.608878:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747800/0xc5f18d5f94ec0a79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.608895:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0a80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.608902:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0a80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.608908:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0a80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.609406:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747600/0xc5f18d5f94ec0a87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.609416:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747600/0xc5f18d5f94ec0a87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.609424:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747600/0xc5f18d5f94ec0a87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707306.609505:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787707306.609510:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787707306.609606:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747600/0xc5f18d5f94ec0a87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.610821:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747800/0xc5f18d5f94ec0a79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.610844:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747800/0xc5f18d5f94ec0a79 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.610852:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747800/0xc5f18d5f94ec0a79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.610858:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa08747800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707306.610863:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747800/0xc5f18d5f94ec0a79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.610870:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747800/0xc5f18d5f94ec0a79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.610886:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:2.0:1787707306.610889:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707306.610893:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747800/0xc5f18d5f94ec0a79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.610899:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747800/0xc5f18d5f94ec0a79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.610915:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0a80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.610921:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0a80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.610926:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0a80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.610931:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa08747000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707306.610940:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0a80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.610946:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0a80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.610955:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cfa12a49700) 00010000:00010000:2.0:1787707306.610957:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707306.610960:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0a80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.610966:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0a80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.611011:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747200/0xc5f18d5f94ec0a72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c5e expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.611024:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747600/0xc5f18d5f94ec0a87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c5e expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.611031:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cfa12a49100) 00010000:00010000:2.0:1787707306.611033:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787707306.611035:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa08747600, rc 0) 00000100:00100000:2.0:1787707306.611115:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+7:9719:x1874546707679744:12345-192.168.204.46@tcp:101:touch.500 Request processed in 41431us (41918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707306.611125:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 21 00000100:00100000:3.0:1787707306.614718:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707306.614931:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707680000 00000100:00100000:0.0:1787707306.614942:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707680000 00000100:00100000:0.0:1787707306.615020:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 22 00000100:00100000:0.0:1787707306.615032:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+7:9719:x1874546707680000:12345-192.168.204.46@tcp:101:touch.500 00010000:00010000:0.0:1787707306.615053:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707306.615075:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0a8e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9c65 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.615488:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0a95 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.615503:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0a95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.615514:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0a95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.615529:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0a9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.615536:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0a9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.615542:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0a9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787707306.617757:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1787707306.618082:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec0aa3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.618097:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec0aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.618108:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec0aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.618149:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0a95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.618156:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0a95 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.618162:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0a95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.618167:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707306.618171:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0a95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.618178:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0a95 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.618190:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cfa12a49100) 00010000:00010000:0.0:1787707306.618193:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707306.618197:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0a95 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.618202:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0a95 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787707306.618214:0:8469:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8ee7db1 reply state 00000000afc3023e transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0a9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707306.618223:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787707306.618255:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0a8e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c65 expref: 10 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.618280:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec0aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c65 expref: 9 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.618287:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cfa19f4e300) 00010000:00010000:0.0:1787707306.618289:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787707306.618292:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3200, rc 0) 00000100:00100000:0.0:1787707306.619599:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+10:9719:x1874546707680000:12345-192.168.204.46@tcp:101:touch.500 Request processed in 4564us (4883us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787707306.619621:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 22 00000100:00100000:3.0:1787707306.633867:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707306.634311:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707680256 00000100:00100000:2.0:1787707306.634323:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707680256 00000100:00100000:2.0:1787707306.634417:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 23 00000100:00100000:2.0:1787707306.634429:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+10:9719:x1874546707680256:12345-192.168.204.46@tcp:36:touch.500 00010000:00010000:2.0:1787707306.634514:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707306.634555:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec0aa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c65 expref: 10 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.634578:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cfa19f4e300) 00010000:00010000:2.0:1787707306.634589:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787707306.634644:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0ab1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.634663:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0ab1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.634673:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0ab1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787707306.634934:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002206bb46 reply state 00000000c6fca1e3 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0ab1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707306.634943:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787707306.635028:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+11:9719:x1874546707680256:12345-192.168.204.46@tcp:36:touch.500 Request processed in 602us (1176us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787707306.635035:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 23 00010000:00010000:1.0:1787707306.635258:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0a9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707306.635272:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0a9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707306.635287:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0a9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707306.635293:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3e00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707306.635297:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0a9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707306.635304:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0a9c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707306.635322:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa6743ac4 (ffff8cfa19f4e200) 00010000:00010000:1.0:1787707306.635326:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707306.635330:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0a9c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707306.635336:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0a9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707306.642477:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707306.642825:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707680384 00000100:00100000:3.0:1787707306.642847:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707680384 00000100:00100000:3.0:1787707306.642911:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 24 00000100:00100000:3.0:1787707306.642921:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+10:9719:x1874546707680384:12345-192.168.204.46@tcp:101:touch.500 00010000:00010000:3.0:1787707306.642947:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707306.642970:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec0ab8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9c6c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.643029:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec0ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c6c expref: 11 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.643044:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec0ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c6c expref: 11 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.643064:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:3.0:1787707306.643067:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787707306.643087:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fc800, rc 0) 00000100:00100000:3.0:1787707306.643154:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+11:9719:x1874546707680384:12345-192.168.204.46@tcp:101:touch.500 Request processed in 234us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707306.643162:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 24 00000100:00100000:0.0:1787707306.647977:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707306.648431:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707680512 00000100:00100000:3.0:1787707306.648442:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707680512 00000100:00100000:3.0:1787707306.648561:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 16 00000100:00100000:3.0:1787707306.648570:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2358:x1874546707680512:12345-192.168.204.46@tcp:8:touch.500 00010000:00080000:3.0:1787707306.648605:0:8265:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-OST0000: connection from 9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp t0 exp 0000000000000000 cur 357 last 0 00000020:00000080:3.0:1787707306.648650:0:8265:0:(genops.c:1385:class_connect()) connect: client 9ed4058d-c366-401f-b84d-540fc0489f0c, cookie 0xc5f18d5f94ec0abf 00002000:00100000:3.0:1787707306.648662:0:8265:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9ed4058d-c366-401f-b84d-540fc0489f0c/ffff8cfa3cba8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787707306.648691:0:8265:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787707306.648983:0:8265:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787707306.649019:0:8265:0:(import.c:65:import_set_state_nolock()) ffff8cfa3cba8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787707306.649106:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2358:x1874546707680512:12345-192.168.204.46@tcp:8:touch.500 Request processed in 534us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707306.649115:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 16 00010000:00010000:2.0:1787707306.650612:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0ab1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.650629:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0ab1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.650636:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0ab1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.650661:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa08747000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707306.650666:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0ab1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.650674:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0ab1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.650694:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:2.0:1787707306.650697:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707306.650702:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0ab1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.650708:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0ab1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707306.658812:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707306.658908:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707680640 00000100:00100000:3.0:1787707306.658919:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707680640 00000100:00100000:3.0:1787707306.659067:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 17 00000100:00100000:3.0:1787707306.659089:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:0:x1874546707680640:12345-192.168.204.46@tcp:2:touch.500 00000100:00080000:2.0:1787707306.666065:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787707306.817327:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+7:0:x1874546707680640:12345-192.168.204.46@tcp:2:touch.500 Request processed in 158230us (158513us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787707306.817339:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 17 00000001:00080000:2.0:1787707306.818222:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:2.0:1787707306.818235:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9ed4058d-c366-401f-b84d-540fc0489f0c 00000100:00100000:0.0:1787707306.820669:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707306.821008:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707680896 00000100:00100000:3.0:1787707306.821019:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707680896 00000100:00100000:3.0:1787707306.821083:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 2 00000100:00100000:3.0:1787707306.821095:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+10:9719:x1874546707680896:12345-192.168.204.46@tcp:35:touch.500 00000100:00100000:3.0:1787707306.821472:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+11:9719:x1874546707680896:12345-192.168.204.46@tcp:35:touch.500 Request processed in 378us (809us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787707306.821480:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 2 00000100:00100000:3.0:1787707306.839351:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707306.839667:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707681024 00000100:00100000:2.0:1787707306.839680:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707681024 00000100:00100000:2.0:1787707306.839910:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 25 00000100:00100000:2.0:1787707306.839924:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+11:9720:x1874546707681024:12345-192.168.204.46@tcp:101:rm.0 00010000:00010000:2.0:1787707306.839950:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707306.839973:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0ac6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9c73 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.840042:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747800/0xc5f18d5f94ec0acd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.840089:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747800/0xc5f18d5f94ec0acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.840101:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747800/0xc5f18d5f94ec0acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707306.840168:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787707306.840172:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787707306.840214:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747800/0xc5f18d5f94ec0acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.840244:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0ac6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c73 expref: 13 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.840264:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747800/0xc5f18d5f94ec0acd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c73 expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.840272:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cfa12a49100) 00010000:00010000:2.0:1787707306.840275:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787707306.840278:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa08747800, rc 0) 00000100:00100000:2.0:1787707306.840342:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+12:9720:x1874546707681024:12345-192.168.204.46@tcp:101:rm.0 Request processed in 421us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707306.840350:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 25 00000100:00100000:1.0:1787707306.852002:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707306.857857:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707681280 00000100:00100000:3.0:1787707306.857877:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707681280 00000100:00100000:3.0:1787707306.858321:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 26 00000100:00100000:3.0:1787707306.858333:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+12:9720:x1874546707681280:12345-192.168.204.46@tcp:101:rm.0 00010000:00010000:3.0:1787707306.858355:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707306.860384:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0ad4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9c7a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707306.860519:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787707306.860702:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0ad4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c7a expref: 14 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.860724:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:2.0:1787707306.862746:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787707306.862761:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0ad4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c7a expref: 14 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.862785:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fd200, rc 0) 00000100:00100000:2.0:1787707306.862883:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+13:9720:x1874546707681280:12345-192.168.204.46@tcp:101:rm.0 Request processed in 4550us (11523us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787707306.862892:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 26 00000100:00100000:0.0:1787707306.868057:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707306.868586:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707681408 00000100:00100000:3.0:1787707306.868598:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707681408 00000100:00100000:3.0:1787707306.868871:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 3 00000100:00100000:3.0:1787707306.868911:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+13:9720:x1874546707681408:12345-192.168.204.46@tcp:37:rm.0 00000100:00100000:1.0:1787707306.877463:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+13:9720:x1874546707681408:12345-192.168.204.46@tcp:37:rm.0 Request processed in 8558us (9404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707306.877477:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 3 00000100:00100000:1.0:1787707306.884049:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707306.884147:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707681664 00000100:00100000:0.0:1787707306.884159:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707681664 00000100:00100000:0.0:1787707306.884216:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 4 00000100:00100000:0.0:1787707306.884226:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa189fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+13:9720:x1874546707681664:12345-192.168.204.46@tcp:35:rm.0 00000100:00100000:0.0:1787707306.884523:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa189fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+14:9720:x1874546707681664:12345-192.168.204.46@tcp:35:rm.0 Request processed in 297us (483us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787707306.884532:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 4 00000100:00100000:3.0:1787707306.890499:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707306.890652:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707681920 00000100:00100000:2.0:1787707306.890661:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707681920 00000100:00100000:2.0:1787707306.890721:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 27 00000100:00100000:2.0:1787707306.890742:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+14:9720:x1874546707681920:12345-192.168.204.46@tcp:101:rm.0 00010000:00010000:2.0:1787707306.890765:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707306.890787:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0ae2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9c81 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.890907:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747200/0xc5f18d5f94ec0ae9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.890923:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747200/0xc5f18d5f94ec0ae9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.890934:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747200/0xc5f18d5f94ec0ae9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707306.890945:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787707306.891093:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0ae2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c81 expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.891111:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747200/0xc5f18d5f94ec0ae9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c81 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.891120:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cfa12a49100) 00010000:00010000:2.0:1787707306.891123:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787707306.891128:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa08747200, rc 0) 00000100:00100000:2.0:1787707306.891189:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+16:9720:x1874546707681920:12345-192.168.204.46@tcp:101:rm.0 Request processed in 460us (699us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787707306.891197:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 27 00000100:00100000:3.0:1787707306.899365:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707306.899494:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707682048 00000100:00100000:0.0:1787707306.899505:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707682048 00000100:00100000:0.0:1787707306.899578:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 28 00000100:00100000:0.0:1787707306.899588:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+16:9720:x1874546707682048:12345-192.168.204.46@tcp:41:rm.0 00000004:00000024:0.0:1787707306.899656:0:8469:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1787707306.899738:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+16:9720:x1874546707682048:12345-192.168.204.46@tcp:41:rm.0 Request processed in 139us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707306.899746:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 28 00000100:00100000:1.0:1787707306.901962:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707306.902036:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707682176 00000100:00100000:2.0:1787707306.902044:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707682176 00000100:00100000:2.0:1787707306.902098:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 29 00000100:00100000:2.0:1787707306.902107:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+16:9720:x1874546707682176:12345-192.168.204.46@tcp:101:rm.0 00010000:00010000:2.0:1787707306.902124:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707306.902144:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0af7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9c88 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902200:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747c00/0xc5f18d5f94ec0afe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902212:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747c00/0xc5f18d5f94ec0afe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902222:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747c00/0xc5f18d5f94ec0afe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902250:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08746a00/0xc5f18d5f94ec0b05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902257:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08746a00/0xc5f18d5f94ec0b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902263:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08746a00/0xc5f18d5f94ec0b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902406:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a000/0xc5f18d5f94ec0b0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902414:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a000/0xc5f18d5f94ec0b0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902421:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a000/0xc5f18d5f94ec0b0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707306.902445:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787707306.902449:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787707306.902466:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a000/0xc5f18d5f94ec0b0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902477:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a000/0xc5f18d5f94ec0b0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902485:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747c00/0xc5f18d5f94ec0afe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902491:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747c00/0xc5f18d5f94ec0afe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902510:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747c00/0xc5f18d5f94ec0afe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902516:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa08747c00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707306.902521:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747c00/0xc5f18d5f94ec0afe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902529:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747c00/0xc5f18d5f94ec0afe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902541:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cfa12a49100) 00010000:00010000:2.0:1787707306.902544:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707306.902548:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747c00/0xc5f18d5f94ec0afe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902554:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747c00/0xc5f18d5f94ec0afe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902566:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08746a00/0xc5f18d5f94ec0b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902572:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08746a00/0xc5f18d5f94ec0b05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902578:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08746a00/0xc5f18d5f94ec0b05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902583:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa08746a00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707306.902586:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08746a00/0xc5f18d5f94ec0b05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902599:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08746a00/0xc5f18d5f94ec0b05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902616:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa6743ac4 (ffff8cfa12a49c00) 00010000:00010000:2.0:1787707306.902619:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707306.902621:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08746a00/0xc5f18d5f94ec0b05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902627:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08746a00/0xc5f18d5f94ec0b05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902654:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747000/0xc5f18d5f94ec0af7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c88 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902665:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a000/0xc5f18d5f94ec0b0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c88 expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707306.902673:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:2.0:1787707306.902675:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787707306.902677:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871a000, rc 0) 00000100:00100000:2.0:1787707306.902823:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+17:9720:x1874546707682176:12345-192.168.204.46@tcp:101:rm.0 Request processed in 716us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707306.902830:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 29 00000100:00100000:0.0:1787707306.905799:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707306.905916:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707682432 00000100:00100000:3.0:1787707306.905925:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707682432 00000100:00100000:3.0:1787707306.905983:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 30 00000100:00100000:3.0:1787707306.905993:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+17:9720:x1874546707682432:12345-192.168.204.46@tcp:36:rm.0 00010000:00010000:3.0:1787707306.906041:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787707306.906075:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a000/0xc5f18d5f94ec0b0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c88 expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.906097:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec0ab8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c6c expref: 16 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.906107:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:3.0:1787707306.906125:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747800/0xc5f18d5f94ec0acd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c73 expref: 15 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.906133:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cfa12a49100) 00010000:00010000:3.0:1787707306.906136:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787707306.906154:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec0b13 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.906169:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec0b13 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.906178:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec0b13 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.906206:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec0b1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.906213:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec0b1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.906220:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec0b1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.906400:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b21 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.906409:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.906416:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787707306.908228:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1787707306.908242:0:8469:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 357954871092ns, next at 358954868683ns, rc = 0 00010000:00010000:3.0:1787707306.908317:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec0b28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.908330:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec0b28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.908339:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec0b28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.908346:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec0b28 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.908365:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec0b28 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.908548:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec0b28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.908571:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787707306.908595:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.908602:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b21 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.908675:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b21 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.908681:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fdc00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707306.908686:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b21 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.908694:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b21 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.908707:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cfa143e4b00) 00010000:00010000:3.0:1787707306.908710:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787707306.908714:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b21 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.908719:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b21 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.908753:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec0b13 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.908766:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec0b13 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.908773:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec0b13 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.908777:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fcc00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707306.908780:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec0b13 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.908786:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec0b13 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.908794:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cfa12a49100) 00010000:00010000:3.0:1787707306.908796:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707306.908800:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec0b13 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.908806:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec0b13 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787707306.908818:0:8469:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000842bb440 reply state 000000002a113aa3 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec0b1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707306.908827:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787707306.908970:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787707306.908977:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec0b28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.908983:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd600 already unused, calling callback (ffffffffc1630230) 00010000:00010000:0.0:1787707306.908987:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec0b28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.908993:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec0b28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.909003:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cfa143e4b00) 00010000:00010000:0.0:1787707306.909005:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787707306.909008:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec0b28 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.909013:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec0b28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.909029:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707306.909031:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707306.909032:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707306.909132:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+16:9720:x1874546707682432:12345-192.168.204.46@tcp:36:rm.0 Request processed in 3136us (3337us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787707306.909141:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 30 00010000:00010000:1.0:1787707306.911585:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec0b1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707306.911611:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec0b1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707306.911632:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec0b1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707306.911639:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fda00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707306.911643:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec0b1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707306.911651:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec0b1a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707306.911667:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa6743ac4 (ffff8cfa143e4400) 00010000:00010000:1.0:1787707306.911670:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707306.911674:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec0b1a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707306.911680:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec0b1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707306.914076:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707306.914240:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707682688 00000100:00100000:1.0:1787707306.914249:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707682688 00000100:00100000:1.0:1787707306.914300:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 5 00000100:00100000:1.0:1787707306.914310:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+15:9720:x1874546707682688:12345-192.168.204.46@tcp:35:rm.0 00000100:00100000:1.0:1787707306.914946:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+16:9720:x1874546707682688:12345-192.168.204.46@tcp:35:rm.0 Request processed in 635us (885us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787707306.914955:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 5 00000100:00100000:3.0:1787707306.916993:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707306.917077:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707682944 00000100:00100000:0.0:1787707306.917087:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707682944 00000100:00100000:0.0:1787707306.917140:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 31 00000100:00100000:0.0:1787707306.917150:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+16:9720:x1874546707682944:12345-192.168.204.46@tcp:36:rm.0 00010000:00010000:0.0:1787707306.917206:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787707306.917241:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747200/0xc5f18d5f94ec0ae9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c81 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.917263:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08747600/0xc5f18d5f94ec0a87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c5e expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.917275:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cfa12a49100) 00010000:00010000:0.0:1787707306.917293:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa08746600/0xc5f18d5f94ec0a48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c50 expref: 14 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.917300:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:0.0:1787707306.917307:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787707306.917332:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0b2f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.917344:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0b2f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.917355:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0b2f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.917402:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0b36 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.917411:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0b36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.917434:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0b36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.917969:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0b3d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.917978:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0b3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.917987:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0b3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707306.919264:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787707306.919283:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0b3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.919292:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0b3d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.919298:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0b3d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.919304:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707306.919308:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0b3d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.919316:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0b3d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.919329:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cfa19f4e500) 00010000:00010000:0.0:1787707306.919332:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787707306.919343:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0b3d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.919349:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0b3d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.919824:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0b2f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.919832:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0b2f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.919838:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0b2f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.919843:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707306.919846:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0b2f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.919853:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0b2f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.919862:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa19f4ed00) 00010000:00010000:0.0:1787707306.919864:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707306.919867:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0b2f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707306.919873:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0b2f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787707306.919886:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb7a87b7 reply state 0000000052211d2f transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0b36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707306.919955:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787707306.922465:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+15:9720:x1874546707682944:12345-192.168.204.46@tcp:36:rm.0 Request processed in 5306us (5469us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787707306.922477:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 31 00010000:00010000:3.0:1787707306.929492:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0b36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.929526:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0b36 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.929534:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0b36 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.929540:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707306.929546:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0b36 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.929554:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0b36 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.929570:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cfa19f4e600) 00010000:00010000:3.0:1787707306.929574:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707306.929579:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0b36 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707306.929585:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0b36 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707307.257683:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707308.285118:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707308.344950:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729739392:0@lo:400:kworker.0 00000100:00100000:3.0:1787707308.345058:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707308.345137:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729739904:0@lo:400:kworker.0 00000100:00100000:3.0:1787707308.345167:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707308.345204:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787707308.345210:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729739264:0@lo:400:kworker.0 00000100:00100000:0.0:1787707308.345453:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729739392 00000100:00100000:0.0:1787707308.345465:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729739392 00000100:00100000:0.0:1787707308.345530:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787707308.345541:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729739392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707308.345637:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729739648:0@lo:400:kworker.0 00000100:00100000:1.0:1787707308.345643:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729739520:0@lo:400:kworker.0 00000100:00100000:3.0:1787707308.345725:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707308.345805:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729739392:12345-0@lo:400:kworker.0 Request processed in 265us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707308.345814:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787707308.349212:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707308.349337:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707308.349548:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729739776:0@lo:400:kworker.0 00000100:00100000:3.0:1787707308.349589:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707308.349691:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729739392:0@lo:400:kworker.0 00000100:00100000:0.0:1787707308.349746:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729739520 00000100:00100000:0.0:1787707308.349756:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729739520 00000100:00100000:0.0:1787707308.349832:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729739776 00000100:00100000:0.0:1787707308.349835:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729739776 00000100:00100000:0.0:1787707308.349853:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787707308.349863:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729739520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707308.349921:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729739520:12345-0@lo:400:kworker.0 Request processed in 59us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707308.349928:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787707308.349944:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787707308.349949:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729739776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707308.349974:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729739776:12345-0@lo:400:kworker.0 Request processed in 25us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707308.349979:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787707308.350008:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729739520:0@lo:400:kworker.0 00000100:00100000:3.0:1787707308.352295:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729739904 00000100:00100000:3.0:1787707308.352319:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729739904 00000100:00100000:3.0:1787707308.352424:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729739648 00000100:00100000:3.0:1787707308.352429:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729739648 00000100:00100000:3.0:1787707308.352463:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787707308.352475:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729739904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707308.352591:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729739904:12345-0@lo:400:kworker.0 Request processed in 119us (7423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707308.352599:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787707308.352620:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787707308.356424:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729739648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707308.356783:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729739648:12345-0@lo:400:kworker.0 Request processed in 4152us (7581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707308.356798:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787707308.356951:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729739264 00000100:00100000:3.0:1787707308.356962:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729739264 00000100:00100000:3.0:1787707308.357017:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787707308.357027:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729739264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707308.357070:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729739264:12345-0@lo:400:kworker.0 Request processed in 45us (11344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707308.357076:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787707308.357140:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729739264:0@lo:400:kworker.0 00000100:00100000:3.0:1787707308.357160:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729739776:0@lo:400:kworker.0 00010000:00080000:3.0:1787707308.357197:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3abffb80 x1874546729739904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707308.357209:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729739904:0@lo:400:kworker.0 00000100:00080000:3.0:1787707308.357272:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787707308.357278:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787707308.357282:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787707308.357303:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3abfca80 x1874546729739648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707308.357314:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729739648:0@lo:400:kworker.0 00000100:00100000:2.0:1787707308.856705:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729740032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787707308.856796:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707308.857827:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729740032 00000100:00100000:0.0:1787707308.857838:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729740032 00000100:00100000:0.0:1787707308.857908:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787707308.857919:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729740032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787707308.857959:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707308.858029:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729740032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707308.858036:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1787707308.858089:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3abff100 x1874546729740032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707308.858109:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729740032:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787707309.304607:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707309.960678:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707309.960717:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707309.960744:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707683072 00000100:00100000:2.0:1787707309.960754:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707309.960758:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707683072 00000100:00100000:2.0:1787707309.960791:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707309.960815:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 256 00000100:00100000:0.0:1787707309.960829:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa18a93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:2359:x1874546707683072:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707309.960832:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707683200 00000100:00100000:2.0:1787707309.960838:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707683200 00000100:00100000:2.0:1787707309.960883:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707683456 00000100:00100000:2.0:1787707309.960886:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707683456 00000100:00100000:0.0:1787707309.960910:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa18a93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:2359:x1874546707683072:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 85us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707309.960919:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 121 00000100:00100000:0.0:1787707309.960922:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 256 00000100:00100000:2.0:1787707309.960933:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+14:2359:x1874546707683200:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707309.960977:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+14:2359:x1874546707683200:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 48us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707309.960984:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 121 00000100:00100000:2.0:1787707309.961000:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 122 00000100:00100000:2.0:1787707309.961007:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2359:x1874546707683456:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707309.961034:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2359:x1874546707683456:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 28us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707309.961041:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 122 00000100:00100000:1.0:1787707309.961895:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707683328 00000100:00100000:1.0:1787707309.961904:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707683328 00000100:00100000:1.0:1787707309.961959:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 66 00000100:00100000:1.0:1787707309.961967:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2359:x1874546707683328:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707309.962029:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2359:x1874546707683328:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 62us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707309.962659:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 66 00000100:00080000:2.0:1787707309.963621:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787707309.963628:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787707310.330887:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707311.352507:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787707311.417433:0:6918:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 362464058954ns, next at 363464055602ns, rc = 0 00000100:00100000:3.0:1787707311.418796:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa418ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729740160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787707311.418911:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707311.421027:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729740160 00000100:00100000:0.0:1787707311.421048:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729740160 00000100:00100000:0.0:1787707311.421151:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787707311.421166:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729740160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787707311.421226:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707311.421349:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729740160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (2438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707311.421357:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1787707311.421910:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa418ec700 x1874546729740160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707311.421938:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa418ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729740160:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787707311.422032:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1787707311.737765:0:11622:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:0.0:1787707312.007764:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1787707312.013307:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:0.0:1787707312.013355:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1787707312.013737:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa418edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729740288:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787707312.013843:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707312.014052:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729740288 00000100:00100000:2.0:1787707312.014062:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729740288 00000100:00100000:2.0:1787707312.014140:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787707312.014152:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729740288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787707312.014185:0:6689:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1787707312.014230:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8e3fa9, atime: 0x6a8e3fa9, ctime: 0x6a8e3fa9, blocks: 0x1 00010000:00010000:2.0:1787707312.014239:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec0b44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707312.014259:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=363s v=(0 0) 00010000:00010000:2.0:1787707312.014264:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707312.014272:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec0b44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707312.014292:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec0b44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707312.014302:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec0b44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707312.014311:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec0b44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707312.014338:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787707312.016081:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1874546729740288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1923us (2230us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787707312.016279:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1787707312.016445:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfa418edf80/2, rc 0, transno 4294967300 00000100:00100000:0.0:1787707312.016453:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa418edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729740288:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787707312.016664:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787707312.016674:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec0b44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707312.016688:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b400 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707312.016693:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec0b44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707312.016705:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec0b44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707312.016729:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec0b44 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707312.016738:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec0b44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707312.016764:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707312.016766:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707312.016769:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707312.379478:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787707313.281698:0:11674:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea9c265a0 20000000:00000080:3.0:1787707313.281726:0:11674:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cfa3f94d800 uarg=0000000000000000 20000000:01000000:3.0:1787707313.281778:0:11674:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787707313.281786:0:11674:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787707313.281793:0:11674:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1787707313.285213:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787707313.285706:0:11674:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787707313.300115:0:11674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787707313.300179:0:11674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787707313.300248:0:11674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787707313.300340:0:11674:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787707313.300582:0:11674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfa0871b600/0xc5f18d5f94ec0b4b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707313.300638:0:11674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c3b expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707313.300647:0:11674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa029d4000/0xc5f18d5f94ec09ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c42 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707313.300657:0:11674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa00031200/0xc5f18d5f94ec09fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec09f4 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707313.300663:0:11674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa00030800/0xc5f18d5f94ec0a09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0a02 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707313.300669:0:11674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0a17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0a10 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707313.300676:0:11674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfa0871b600/0xc5f18d5f94ec0b4b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707313.300732:0:11674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0a17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec0a10 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707313.300751:0:11674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0a17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0a10 expref: 18 pid: 5848 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707313.300771:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa418ef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874546729740416:0@lo:104: 00000100:00100000:2.0:1787707313.301274:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787707313.301437:0:11674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa00030800/0xc5f18d5f94ec0a09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec0a02 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707313.301460:0:11674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa00030800/0xc5f18d5f94ec0a09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0a02 expref: 18 pid: 5848 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707313.301481:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa418edc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874546729740544:0@lo:104: 00000100:00100000:2.0:1787707313.301576:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787707313.302075:0:11674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa00031200/0xc5f18d5f94ec09fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec09f4 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707313.302086:0:11674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfa00031200/0xc5f18d5f94ec09fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec09f4 expref: 18 pid: 5850 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707313.302097:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa418ed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874546729740672:0@lo:104: 00000100:00100000:2.0:1787707313.302128:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707313.302208:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729740416 00000100:00100000:3.0:1787707313.302217:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729740416 00000100:00100000:3.0:1787707313.302280:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729740544 00000100:00100000:3.0:1787707313.302283:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729740544 00000100:00100000:3.0:1787707313.302300:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787707313.302312:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+4:11674:x1874546729740416:12345-0@lo:104: 00010000:00010000:3.0:1787707313.302334:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa08746800/0xc5f18d5f94ec0a10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0a17 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.302428:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787707313.302435:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+4:11674:x1874546729740416:12345-0@lo:104: Request processed in 125us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707313.302453:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787707313.302474:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787707313.302481:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:11674:x1874546729740544:12345-0@lo:104: 00010000:00010000:3.0:1787707313.302500:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa08746c00/0xc5f18d5f94ec0a02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0a09 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.302540:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787707313.302545:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:11674:x1874546729740544:12345-0@lo:104: Request processed in 65us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707313.302551:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1787707313.302589:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787707313.302598:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa08746800/0xc5f18d5f94ec0a10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0a17 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.302617:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa08746800 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:3.0:1787707313.302622:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa08746800/0xc5f18d5f94ec0a10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec0a17 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.302632:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa08746800/0xc5f18d5f94ec0a10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec0a17 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787707313.302641:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa08746800/0xc5f18d5f94ec0a10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec0a17 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787707313.302654:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787707313.302687:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa08746800/0xc5f18d5f94ec0a10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0a17 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.302693:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787707313.302720:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa08746800/0xc5f18d5f94ec0a10 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0a17 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.302728:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa08746800/0xc5f18d5f94ec0a10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0a17 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.302743:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707313.302746:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa08746c00/0xc5f18d5f94ec0a02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec0a09 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.302752:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa08746c00 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:3.0:1787707313.302755:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa08746c00/0xc5f18d5f94ec0a02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec0a09 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.302762:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa08746c00/0xc5f18d5f94ec0a02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec0a09 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787707313.302768:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa08746c00/0xc5f18d5f94ec0a02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec0a09 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787707313.302774:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787707313.302787:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa08746c00/0xc5f18d5f94ec0a02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0a09 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.302793:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787707313.302819:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa08746c00/0xc5f18d5f94ec0a02 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0a09 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.302827:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa08746c00/0xc5f18d5f94ec0a02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec0a09 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.303142:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707313.303145:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707313.303148:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707313.303171:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729740800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787707313.303217:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707313.303269:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729740928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787707313.303294:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707313.303336:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729740800 00000100:00100000:3.0:1787707313.303342:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729740800 00010000:00010000:3.0:1787707313.303413:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0a17 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0a10 expref: 19 pid: 5848 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707313.303438:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729740928 00000100:00100000:3.0:1787707313.303451:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729740928 00010000:00010000:3.0:1787707313.303466:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa00030800/0xc5f18d5f94ec0a09 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0a02 expref: 20 pid: 5848 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707313.303639:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787707313.303649:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+20:3315:x1874546729740800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787707313.303663:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707313.303670:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0a17 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0a10 expref: 20 pid: 5848 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.303686:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0a17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0a10 expref: 20 pid: 5848 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.303722:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707313.303761:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+20:3315:x1874546729740800:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707313.303770:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787707313.303791:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787707313.303797:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3316:x1874546729740928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787707313.303806:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707313.303810:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa00030800/0xc5f18d5f94ec0a09 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0a02 expref: 19 pid: 5848 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.303820:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa00030800/0xc5f18d5f94ec0a09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec0a02 expref: 19 pid: 5848 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.303831:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787707313.303986:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707313.304133:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3316:x1874546729740928:12345-0@lo:103:ldlm_bl.0 Request processed in 336us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707313.304141:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787707313.304198:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729740800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787707313.304343:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729740928:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787707313.304824:0:11674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa029d4000/0xc5f18d5f94ec09ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c42 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707313.304854:0:11674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfa029d4000/0xc5f18d5f94ec09ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c42 expref: 12 pid: 5848 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707313.304869:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa418ec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874546729741056:192.168.204.46@tcp:104: 00010000:00010000:2.0:1787707313.305090:0:11674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c3b expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707313.305099:0:11674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c3b expref: 12 pid: 5851 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707313.305108:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874546729741184:192.168.204.46@tcp:104: 00000100:00100000:2.0:1787707313.305134:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa087029c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787707313.305153:0:11674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec0a17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec0a10 expref: 18 pid: 5848 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707313.305186:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa418ef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874546729740416:0@lo:104: 00010000:00010000:2.0:1787707313.305201:0:11674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa00030800/0xc5f18d5f94ec0a09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec0a02 expref: 17 pid: 5848 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707313.305210:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa418edc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874546729740544:0@lo:104: 00000100:00100000:0.0:1787707313.306089:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729740672 00000100:00100000:0.0:1787707313.306100:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729740672 00000100:00100000:2.0:1787707313.306414:0:5839:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787707313.306440:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787707313.306463:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:11674:x1874546729740672:12345-0@lo:104: 00010000:00010000:2.0:1787707313.306482:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa08746400/0xc5f18d5f94ec09f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec09fb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707313.306589:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787707313.306595:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+3:11674:x1874546729740672:12345-0@lo:104: Request processed in 137us (4466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707313.306602:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787707313.307149:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa418ed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874546729740672:0@lo:104: 00010000:00010000:1.0:1787707313.307303:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787707313.307314:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa08746400/0xc5f18d5f94ec09f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec09fb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707313.307324:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa08746400 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:1.0:1787707313.307329:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa08746400/0xc5f18d5f94ec09f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec09fb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707313.307340:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa08746400/0xc5f18d5f94ec09f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec09fb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787707313.307349:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa08746400/0xc5f18d5f94ec09f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec09fb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707313.307750:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787707313.307814:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa08746400/0xc5f18d5f94ec09f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec09fb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707313.307822:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787707313.307973:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa08746400/0xc5f18d5f94ec09f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec09fb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707313.307982:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa08746400/0xc5f18d5f94ec09f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec09fb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707313.308009:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707313.308012:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707313.308014:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707313.308027:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787707313.308050:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729741312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787707313.308130:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707313.308198:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729741312 00000100:00100000:1.0:1787707313.308206:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729741312 00010000:00010000:1.0:1787707313.308243:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa00031200/0xc5f18d5f94ec09fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec09f4 expref: 17 pid: 5850 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707313.308757:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787707313.308770:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa113cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:3316:x1874546729741312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787707313.308787:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707313.308793:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa00031200/0xc5f18d5f94ec09fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec09f4 expref: 17 pid: 5850 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707313.308809:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa00031200/0xc5f18d5f94ec09fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec09f4 expref: 17 pid: 5850 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707313.309156:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa00031200/0xc5f18d5f94ec09fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec09f4 expref: 17 pid: 5850 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707313.309178:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707313.309246:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa113cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:3316:x1874546729741312:12345-0@lo:103:ldlm_bl.0 Request processed in 479us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707313.309356:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787707313.309764:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729741312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787707313.311691:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa418ec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874546729741056:192.168.204.46@tcp:104: 00000100:00100000:3.0:1787707313.311710:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874546729741184:192.168.204.46@tcp:104: 00010000:00010000:3.0:1787707313.311751:0:11674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfa0871b600/0xc5f18d5f94ec0b4b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707313.311868:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707313.311922:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707313.312000:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707683584 00000100:00100000:3.0:1787707313.312018:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707683584 00010000:00010000:3.0:1787707313.312088:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa029d4000/0xc5f18d5f94ec09ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c42 expref: 13 pid: 5848 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707313.312130:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707683712 00000100:00100000:3.0:1787707313.312134:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707683712 00010000:00010000:3.0:1787707313.312149:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c3b expref: 14 pid: 5851 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707313.312172:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 33 00000100:00100000:3.0:1787707313.312183:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60f5ae37-220d-45d9-b012-b91715df156e+14:2362:x1874546707683584:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787707313.312201:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707313.312208:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa029d4000/0xc5f18d5f94ec09ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c42 expref: 14 pid: 5848 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.312223:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa029d4000/0xc5f18d5f94ec09ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c42 expref: 14 pid: 5848 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.312246:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa029d4000/0xc5f18d5f94ec09ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c42 expref: 14 pid: 5848 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.312268:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707313.312333:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60f5ae37-220d-45d9-b012-b91715df156e+13:2362:x1874546707683584:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 151us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707313.312342:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 33 00000100:00100000:3.0:1787707313.312363:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 34 00000100:00100000:3.0:1787707313.312614:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60f5ae37-220d-45d9-b012-b91715df156e+12:2362:x1874546707683712:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787707313.312628:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707313.312633:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c3b expref: 12 pid: 5851 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.312650:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c3b expref: 12 pid: 5851 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.312662:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa00031c00/0xc5f18d5f94ec09e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c3b expref: 12 pid: 5851 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.312677:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfa0871b600/0xc5f18d5f94ec0b4b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.312686:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa0871b600/0xc5f18d5f94ec0b4b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.312703:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa0871b600/0xc5f18d5f94ec0b4b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.312711:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa0871b600/0xc5f18d5f94ec0b4b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.312720:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfa0871b600/0xc5f18d5f94ec0b4b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.312727:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfa0871b600/0xc5f18d5f94ec0b4b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.312735:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b600 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707313.312740:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfa0871b600/0xc5f18d5f94ec0b4b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.312750:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfa0871b600/0xc5f18d5f94ec0b4b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.312780:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfa0871b600/0xc5f18d5f94ec0b4b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.312790:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707313.312814:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60f5ae37-220d-45d9-b012-b91715df156e+11:2362:x1874546707683712:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 444us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707313.312822:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 34 00010000:00010000:3.0:1787707313.312851:0:11674:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfa0871b600/0xc5f18d5f94ec0b4b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.312859:0:11674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfa0871b600/0xc5f18d5f94ec0b4b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.312864:0:11674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa0871b600/0xc5f18d5f94ec0b4b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707313.402142:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707313.476822:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874546729741568:0@lo:400:kworker.0 00000100:00100000:2.0:1787707313.477063:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707313.477298:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729741440:0@lo:400:kworker.0 00000100:00100000:1.0:1787707313.477339:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707313.478332:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729741696:0@lo:400:kworker.0 00000100:00100000:2.0:1787707313.478850:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707313.479349:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787707313.479361:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874546729741824:0@lo:400:kworker.0 00000100:00100000:2.0:1787707313.479871:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707313.480026:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729741952:0@lo:400:kworker.0 00000100:00100000:0.0:1787707313.480839:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729741568 00000100:00100000:0.0:1787707313.480856:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729741568 00000100:00100000:1.0:1787707313.481358:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707313.481717:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729741440 00000100:00080000:1.0:1787707313.482618:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707313.482987:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729741440 00000100:00100000:0.0:1787707313.483049:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729741824 00000100:00100000:0.0:1787707313.483054:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729741824 00000100:00080000:1.0:1787707313.483593:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707313.484054:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787707313.484070:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874546729741568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707313.485010:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787707313.485030:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729741440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707313.485101:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729741440:12345-0@lo:400:kworker.0 Request processed in 76us (7762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707313.485109:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787707313.485134:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787707313.485141:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874546729741824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707313.485814:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874546729741568:12345-0@lo:400:kworker.0 Request processed in 654us (7657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707313.485830:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787707313.485954:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874546729741568:0@lo:400:kworker.0 00000100:00100000:2.0:1787707313.486688:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874546729741824:12345-0@lo:400:kworker.0 Request processed in 38us (5308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707313.486700:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787707313.486875:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729741696 00000100:00100000:0.0:1787707313.486887:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729741696 00000100:00100000:0.0:1787707313.486986:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729741952 00000100:00100000:0.0:1787707313.486990:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729741952 00000100:00100000:0.0:1787707313.487023:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787707313.487034:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1874546729741696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707313.487159:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1874546729741696:12345-0@lo:400:kworker.0 Request processed in 126us (8309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707313.487166:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787707313.487818:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787707313.487835:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729741952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707313.487898:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729741952:12345-0@lo:400:kworker.0 Request processed in 69us (6541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707313.487906:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1787707313.488116:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787707313.488122:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787707313.488300:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729741440:0@lo:400:kworker.0 00010000:00080000:2.0:1787707313.488322:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa1101ce00 x1874546729741952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707313.488336:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729741952:0@lo:400:kworker.0 00000100:00100000:2.0:1787707313.488851:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874546729741824:0@lo:400:kworker.0 00000100:00100000:2.0:1787707313.488871:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729741696:0@lo:400:kworker.0 00000100:00100000:1.0:1787707313.976992:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729742080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787707313.977105:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707313.977819:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729742080 00000100:00100000:0.0:1787707313.977833:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729742080 00000100:00100000:0.0:1787707313.977904:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787707313.977935:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729742080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787707313.977981:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707313.978064:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729742080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707313.978073:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1787707313.978962:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3abfc700 x1874546729742080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707313.978990:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729742080:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787707314.424959:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787707314.936510:0:5853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787707314.936522:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfa3f9b5800 from 7 10000000:01000000:2.0:1787707314.936540:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787707314.936638:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b000/0xc5f18d5f94ec0b52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707314.936653:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b000/0xc5f18d5f94ec0b52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707314.936668:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b000/0xc5f18d5f94ec0b52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707314.936704:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729742208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787707314.936826:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707314.936967:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa19e956c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787707314.938130:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729742208 00000100:00100000:3.0:1787707314.938143:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729742208 00000100:00100000:3.0:1787707314.938607:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787707314.938625:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa18a93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:5853:x1874546729742208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787707314.938648:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707314.938675:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec0b59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0b52 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707314.938714:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec0b59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0b52 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707314.938727:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec0b59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0b52 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707314.938759:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fcc00, rc 0) 00000100:00100000:3.0:1787707314.938863:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa18a93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729742208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 243us (2036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707314.938941:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729742208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787707314.938964:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b000/0xc5f18d5f94ec0b52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0b59 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707314.938975:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b000/0xc5f18d5f94ec0b52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0b59 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707314.939059:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729742336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787707314.939105:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707314.939150:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa19e956c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707314.939246:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729742336 00000100:00100000:0.0:1787707314.939252:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729742336 00000100:00100000:0.0:1787707314.939278:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787707314.939286:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa18a91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729742336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787707314.939657:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa18a91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729742336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 371us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707314.939665:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787707314.939881:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729742336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787707314.939924:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729742464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787707314.939979:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707314.940008:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa19e956c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787707314.940677:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787707314.940714:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729742464 00000100:00100000:3.0:1787707314.940719:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729742464 00000100:00100000:3.0:1787707314.940751:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787707314.940759:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729742464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787707314.940988:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729742464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707314.940995:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787707314.941274:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729742464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787707314.941861:0:11687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:11687:1874546729742592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787707314.941929:0:11687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707314.941976:0:11687:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa19e95480 going to sleep for 11 seconds 00000100:00100000:1.0:1787707314.942041:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729742592 00000100:00100000:1.0:1787707314.942047:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729742592 00000100:00100000:1.0:1787707314.942200:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787707314.942211:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:11687:x1874546729742592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787707314.942671:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:11687:x1874546729742592:12345-0@lo:502:llog_process_th.0 Request processed in 463us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707314.942680:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787707314.942798:0:11687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:11687:1874546729742592:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787707314.942836:0:11687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787707314.942849:0:11687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707314.942852:0:11687:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787707314.942860:0:11687:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfa3f9b5800 00000020:00000080:2.0:1787707314.942863:0:11687:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787707314.943027:0:11687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:11687:1874546729742720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787707314.943077:0:11687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707314.943201:0:11687:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa19e830c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707314.943305:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729742720 00000100:00100000:1.0:1787707314.943312:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729742720 00000100:00100000:1.0:1787707314.943352:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787707314.943360:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:11687:x1874546729742720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787707314.944201:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:11687:x1874546729742720:12345-0@lo:502:llog_process_th.0 Request processed in 839us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707314.944212:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787707314.944439:0:11687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:11687:1874546729742720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787707314.944478:0:11687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787707314.944486:0:11687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707314.944489:0:11687:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787707314.944494:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787707314.944768:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787707314.944800:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787707314.944819:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b000/0xc5f18d5f94ec0b52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0b59 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707314.944835:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b000/0xc5f18d5f94ec0b52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0b59 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787707314.944850:0:5853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787707314.944854:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfa34ab9800 from 7 10000000:01000000:3.0:1787707314.944857:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787707314.944899:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707314.944908:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707314.944930:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707314.944956:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729742848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787707314.945010:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707314.945053:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2a583000 going to sleep for 11 seconds 00000100:00100000:2.0:1787707314.945117:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729742848 00000100:00100000:2.0:1787707314.945125:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729742848 00000100:00100000:2.0:1787707314.945167:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787707314.945177:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:5853:x1874546729742848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787707314.945190:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707314.945207:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa0871b800/0xc5f18d5f94ec0b67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0b60 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707314.945259:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa0871b800/0xc5f18d5f94ec0b67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0b60 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707314.945271:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa0871b800/0xc5f18d5f94ec0b67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0b60 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707314.945282:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871b800, rc 0) 00000100:00100000:2.0:1787707314.945318:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729742848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707314.945324:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787707314.945478:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729742848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787707314.945493:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0b67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707314.945516:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0b67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707314.945584:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729742976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787707314.945613:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707314.945639:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2a583000 going to sleep for 11 seconds 00000100:00100000:2.0:1787707314.946000:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729742976 00000100:00100000:2.0:1787707314.946006:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729742976 00000100:00100000:2.0:1787707314.946035:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787707314.946043:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729742976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787707314.946712:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729742976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 666us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707314.946722:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787707314.946945:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729742976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787707314.946999:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729743104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787707314.947046:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707314.947086:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2a583000 going to sleep for 11 seconds 00000100:00100000:2.0:1787707314.947149:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729743104 00000100:00100000:2.0:1787707314.947156:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729743104 00000100:00100000:2.0:1787707314.947311:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787707314.947321:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729743104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787707314.947557:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729743104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 237us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707314.947564:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787707314.947849:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729743104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787707314.948111:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:11689:1874546729743232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787707314.948348:0:11689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707314.952028:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729743232 00000100:00100000:3.0:1787707314.952050:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729743232 00000100:00100000:3.0:1787707314.952141:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787707314.952512:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f258b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787707314.952636:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:11689:x1874546729743232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787707314.952984:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:11689:x1874546729743232:12345-0@lo:502:llog_process_th.0 Request processed in 355us (4636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707314.953000:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787707314.953133:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:11689:1874546729743232:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787707314.953191:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787707314.953203:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707314.953206:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787707314.953213:0:11689:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfa34ab9800 00000020:00000080:0.0:1787707314.955457:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787707314.955747:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:11689:1874546729743360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787707314.955848:0:11689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707314.955901:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f258b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787707314.955921:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729743360 00000100:00100000:2.0:1787707314.955932:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729743360 00000100:00100000:2.0:1787707314.956012:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787707314.956024:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:11689:x1874546729743360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787707314.956305:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:11689:x1874546729743360:12345-0@lo:502:llog_process_th.0 Request processed in 277us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707314.956314:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787707314.957159:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:11689:1874546729743360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787707314.957202:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787707314.957225:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707314.957227:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787707314.957232:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787707314.957540:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787707314.957565:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787707314.957588:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0b67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707314.957602:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0b67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707314.957615:0:5853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787707314.957619:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfa02b55800 from 7 10000000:01000000:1.0:1787707314.957622:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787707314.957664:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4600/0xc5f18d5f94ec0b6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707314.957675:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4600/0xc5f18d5f94ec0b6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707314.957686:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4600/0xc5f18d5f94ec0b6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707314.957711:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729743488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787707314.957773:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707314.957901:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3f8509c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707314.959053:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729743488 00000100:00100000:0.0:1787707314.959078:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729743488 00000100:00100000:0.0:1787707314.959163:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787707314.959177:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:5853:x1874546729743488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787707314.959197:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707314.960208:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0b75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec0b6e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707314.963313:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0b75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0b6e expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707314.963335:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0b75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec0b6e expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707314.963347:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3e00, rc 0) 00000100:00100000:0.0:1787707314.963487:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:5853:x1874546729743488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4310us (5710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707314.963498:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787707314.964860:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729743488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787707314.964891:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4600/0xc5f18d5f94ec0b6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0b75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707314.964904:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4600/0xc5f18d5f94ec0b6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0b75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707314.965001:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729743616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787707314.965063:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707314.965107:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3f8509c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707314.965524:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729743616 00000100:00100000:0.0:1787707314.965532:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729743616 00000100:00100000:0.0:1787707314.965603:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787707314.965615:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:5853:x1874546729743616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787707314.965980:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:5853:x1874546729743616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 367us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707314.965990:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787707314.966035:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729743616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787707314.966079:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729743744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787707314.966128:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707314.966154:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3f8509c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707314.966177:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729743744 00000100:00100000:1.0:1787707314.966182:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729743744 00000100:00100000:1.0:1787707314.966208:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787707314.966214:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:5853:x1874546729743744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787707314.966410:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:5853:x1874546729743744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707314.966416:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787707314.966452:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:5853:1874546729743744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787707314.967107:0:11691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:11691:1874546729743872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787707314.967248:0:11691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707314.967286:0:11691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3f850cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707314.967336:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729743872 00000100:00100000:0.0:1787707314.967348:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729743872 00000100:00100000:0.0:1787707314.967458:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787707314.967467:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:11691:x1874546729743872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787707314.967790:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:11691:x1874546729743872:12345-0@lo:502:llog_process_th.0 Request processed in 323us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707314.967797:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787707314.970697:0:11691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:11691:1874546729743872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787707314.970758:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787707314.970772:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707314.970774:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787707314.970782:0:11691:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfa02b55800 00000020:00000080:2.0:1787707314.970785:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787707314.970961:0:11691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:11691:1874546729744000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787707314.971064:0:11691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707314.971122:0:11691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41900180 going to sleep for 11 seconds 00000100:00100000:1.0:1787707314.971356:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729744000 00000100:00100000:1.0:1787707314.971365:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729744000 00000100:00100000:1.0:1787707314.971446:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787707314.971458:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:11691:x1874546729744000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787707314.971773:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:11691:x1874546729744000:12345-0@lo:502:llog_process_th.0 Request processed in 315us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707314.971782:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787707314.975586:0:11691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:11691:1874546729744000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787707314.975650:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787707314.975662:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707314.975665:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787707314.975671:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787707314.976022:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787707314.976048:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787707314.976062:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4600/0xc5f18d5f94ec0b6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0b75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707314.976085:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4600/0xc5f18d5f94ec0b6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0b75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787707314.981598:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787707315.075287:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707315.075456:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707683840 00000100:00100000:2.0:1787707315.075472:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707683840 00000100:00100000:2.0:1787707315.075549:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 272 00000100:00100000:2.0:1787707315.075563:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+11:2362:x1874546707683840:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707315.075681:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+11:2362:x1874546707683840:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 121us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707315.075715:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 272 00000100:00100000:0.0:1787707315.078868:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707315.083079:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707315.083708:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707683968 00000100:00100000:2.0:1787707315.083723:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707683968 00000100:00080000:1.0:1787707315.083823:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707315.083856:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707684224 00000100:00100000:0.0:1787707315.083861:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707684224 00000100:00100000:0.0:1787707315.083921:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 126 00000100:00100000:0.0:1787707315.083934:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2362:x1874546707683968:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707315.084047:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2362:x1874546707683968:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 116us (5203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707315.084056:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 126 00000100:00100000:0.0:1787707315.084079:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 127 00000100:00100000:0.0:1787707315.084086:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2361:x1874546707684224:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707315.084113:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2361:x1874546707684224:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 28us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707315.084119:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 127 00000100:00080000:1.0:1787707315.084366:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707315.084476:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707315.085257:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707684096 00000100:00100000:3.0:1787707315.085268:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707684096 00000100:00100000:3.0:1787707315.085339:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 69 00000100:00100000:3.0:1787707315.085351:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2361:x1874546707684096:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707315.085466:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2361:x1874546707684096:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 106us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707315.085474:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 69 00000100:00080000:1.0:1787707315.085940:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787707315.330732:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707315.332121:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707684352 00000100:00100000:2.0:1787707315.332143:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707684352 00000100:00100000:2.0:1787707315.332306:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 273 00000100:00100000:2.0:1787707315.332321:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+11:5602:x1874546707684352:12345-192.168.204.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787707315.332346:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707315.332385:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa0871a400/0xc5f18d5f94ec0b7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9c8f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707315.332442:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa0871a400/0xc5f18d5f94ec0b7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c8f expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707315.332464:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa0871a400/0xc5f18d5f94ec0b7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c8f expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707315.332475:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871a400, rc 0) 00000100:00100000:2.0:1787707315.332576:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+12:5602:x1874546707684352:12345-192.168.204.46@tcp:101:ll_cfg_requeue.0 Request processed in 250us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707315.332584:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 273 00000100:00100000:3.0:1787707315.341201:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707315.341290:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707684480 00000100:00100000:1.0:1787707315.341306:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707684480 00000100:00100000:1.0:1787707315.341431:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 274 00000100:00100000:1.0:1787707315.341444:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+12:5602:x1874546707684480:12345-192.168.204.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787707315.342065:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+12:5602:x1874546707684480:12345-192.168.204.46@tcp:501:ll_cfg_requeue.0 Request processed in 622us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707315.342077:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 274 00000100:00100000:0.0:1787707315.348235:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707315.348350:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707684608 00000100:00100000:2.0:1787707315.348364:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707684608 00000100:00100000:2.0:1787707315.348482:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 275 00000100:00100000:2.0:1787707315.348494:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+12:5602:x1874546707684608:12345-192.168.204.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787707315.349136:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+12:5602:x1874546707684608:12345-192.168.204.46@tcp:503:ll_cfg_requeue.0 Request processed in 641us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707315.349158:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 275 00000100:00100000:0.0:1787707315.353925:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707315.354923:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707684736 00000100:00100000:2.0:1787707315.354942:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707684736 00000100:00100000:2.0:1787707315.355033:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 276 00000100:00100000:2.0:1787707315.355048:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+12:9991:x1874546707684736:12345-192.168.204.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787707315.355423:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+12:9991:x1874546707684736:12345-192.168.204.46@tcp:502:llog_process_th.0 Request processed in 377us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707315.355433:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 276 00000100:00100000:3.0:1787707315.362673:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707315.364701:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707684864 00000100:00100000:2.0:1787707315.364720:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707684864 00000100:00100000:2.0:1787707315.364818:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 277 00000100:00100000:2.0:1787707315.364831:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+12:9991:x1874546707684864:12345-192.168.204.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787707315.365193:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+12:9991:x1874546707684864:12345-192.168.204.46@tcp:502:llog_process_th.0 Request processed in 363us (2535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707315.365201:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 277 00000100:00100000:0.0:1787707315.369834:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707315.371945:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707684992 00000100:00100000:2.0:1787707315.371976:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707684992 00000100:00100000:2.0:1787707315.372071:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 278 00000100:00100000:2.0:1787707315.372085:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+12:5602:x1874546707684992:12345-192.168.204.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787707315.372109:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707315.372134:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa0871ac00/0xc5f18d5f94ec0b83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9c96 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707315.372174:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa0871ac00/0xc5f18d5f94ec0b83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c96 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707315.372212:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa0871ac00/0xc5f18d5f94ec0b83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c96 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707315.372225:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871ac00, rc 0) 00000100:00100000:2.0:1787707315.372307:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:5602:x1874546707684992:12345-192.168.204.46@tcp:101:ll_cfg_requeue.0 Request processed in 224us (2489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707315.372315:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 278 00000100:00100000:0.0:1787707315.383456:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707315.383876:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707685120 00000100:00100000:1.0:1787707315.383892:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707685120 00000100:00100000:1.0:1787707315.383985:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 279 00000100:00100000:1.0:1787707315.383999:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:5602:x1874546707685120:12345-192.168.204.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787707315.384745:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:5602:x1874546707685120:12345-192.168.204.46@tcp:501:ll_cfg_requeue.0 Request processed in 742us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707315.384756:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 279 00000100:00100000:3.0:1787707315.390740:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707315.390869:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707685248 00000100:00100000:2.0:1787707315.390884:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707685248 00000100:00100000:2.0:1787707315.390967:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 280 00000100:00100000:2.0:1787707315.390980:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:5602:x1874546707685248:12345-192.168.204.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787707315.391294:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:5602:x1874546707685248:12345-192.168.204.46@tcp:503:ll_cfg_requeue.0 Request processed in 315us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707315.391304:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 280 00000100:00100000:0.0:1787707315.399936:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707315.400122:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707685376 00000100:00100000:1.0:1787707315.400137:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707685376 00000100:00100000:1.0:1787707315.400227:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 281 00000100:00100000:1.0:1787707315.400239:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:9994:x1874546707685376:12345-192.168.204.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787707315.400647:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:9994:x1874546707685376:12345-192.168.204.46@tcp:502:llog_process_th.0 Request processed in 409us (1919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707315.400658:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 281 00000100:00100000:3.0:1787707315.406194:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707315.407429:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707685504 00000100:00100000:0.0:1787707315.407447:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707685504 00000100:00100000:0.0:1787707315.407525:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 282 00000100:00100000:0.0:1787707315.407550:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+13:9994:x1874546707685504:12345-192.168.204.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787707315.407924:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+13:9994:x1874546707685504:12345-192.168.204.46@tcp:502:llog_process_th.0 Request processed in 386us (1744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707315.407934:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 282 00010000:00010000:1.0:1787707315.450054:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787707316.025732:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787707316.472872:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707316.538039:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787707316.538072:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729744128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787707316.538173:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707316.538349:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729744128 00000100:00100000:1.0:1787707316.538361:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729744128 00000100:00100000:1.0:1787707316.538656:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787707316.538670:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874546729744128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787707316.538734:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787707316.538798:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874546729744128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707316.538829:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1787707316.538890:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787707316.539227:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729744128:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787707317.103299:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:1.0:1787707317.496830:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707318.520819:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707318.587756:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874546729744512:0@lo:400:kworker.0 00000100:00100000:0.0:1787707318.587830:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707318.587914:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787707318.587922:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729744384:0@lo:400:kworker.0 00000100:00100000:0.0:1787707318.587946:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707318.587963:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729744896:0@lo:400:kworker.0 00000100:00100000:0.0:1787707318.587987:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707318.588023:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729744512 00000100:00100000:0.0:1787707318.588032:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729744512 00000100:00100000:0.0:1787707318.588086:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729744384 00000100:00100000:0.0:1787707318.588089:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729744384 00000100:00100000:0.0:1787707318.588109:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787707318.588116:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874546729744512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707318.588163:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874546729744512:12345-0@lo:400:kworker.0 Request processed in 47us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707318.588170:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787707318.588185:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787707318.588205:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729744384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707318.588231:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729744384:12345-0@lo:400:kworker.0 Request processed in 26us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707318.588237:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787707318.588254:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729744896 00000100:00100000:0.0:1787707318.588257:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729744896 00000100:00100000:0.0:1787707318.588279:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787707318.588285:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729744896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707318.588314:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729744896:12345-0@lo:400:kworker.0 Request processed in 30us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707318.588320:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1787707318.588336:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787707318.588340:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787707318.588873:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729744640:0@lo:400:kworker.0 00000100:00100000:2.0:1787707318.588917:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707318.588941:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787707318.588947:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729744256:0@lo:400:kworker.0 00000100:00100000:2.0:1787707318.588974:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707318.588999:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874546729744768:0@lo:400:kworker.0 00000100:00100000:2.0:1787707318.589021:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707318.589053:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729744256 00000100:00100000:2.0:1787707318.589057:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729744256 00000100:00100000:2.0:1787707318.589102:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787707318.589108:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3316:x1874546729744256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707318.589148:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3316:x1874546729744256:12345-0@lo:400:kworker.0 Request processed in 40us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707318.589154:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787707318.589201:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729744256:0@lo:400:kworker.0 00000100:00100000:2.0:1787707318.589223:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729744768 00000100:00100000:2.0:1787707318.589227:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729744768 00000100:00100000:2.0:1787707318.589257:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787707318.589263:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874546729744768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707318.589296:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874546729744768:12345-0@lo:400:kworker.0 Request processed in 33us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707318.589302:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787707318.589329:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874546729744768:0@lo:400:kworker.0 00000100:00080000:2.0:1787707318.589346:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787707318.589421:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729744384:0@lo:400:kworker.0 00010000:00080000:2.0:1787707318.589434:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3abfe300 x1874546729744896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707318.589444:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729744896:0@lo:400:kworker.0 00000100:00100000:2.0:1787707318.589456:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874546729744512:0@lo:400:kworker.0 00000100:00100000:2.0:1787707318.589483:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729744640 00000100:00100000:2.0:1787707318.589486:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729744640 00000100:00100000:2.0:1787707318.589527:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787707318.589534:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729744640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707318.589580:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729744640:12345-0@lo:400:kworker.0 Request processed in 47us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707318.589587:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787707318.589609:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1787707318.589615:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfa418edf80, transno 4294967300 00000100:00100000:2.0:1787707318.589626:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729744640:0@lo:400:kworker.0 00000100:00080000:2.0:1787707318.589984:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787707319.097396:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787707319.097420:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729745024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787707319.097508:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707319.097564:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729745024 00000100:00100000:1.0:1787707319.097573:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729745024 00000100:00100000:1.0:1787707319.097635:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787707319.097673:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729745024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787707319.097713:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787707319.097780:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729745024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707319.097787:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1787707319.097947:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3abffb80 x1874546729745024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707319.097968:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729745024:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787707319.544752:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707320.198405:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707320.198457:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707320.198569:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707685760 00000100:00100000:2.0:1787707320.198579:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707685760 00000100:00100000:2.0:1787707320.198657:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 131 00000100:00100000:2.0:1787707320.198667:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2361:x1874546707685760:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707320.198737:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2361:x1874546707685760:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 72us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707320.198744:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 131 00000100:00080000:3.0:1787707320.198882:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707320.199158:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707320.199189:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707320.200850:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707685888 00000100:00100000:3.0:1787707320.200863:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707685888 00000100:00100000:3.0:1787707320.200943:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 72 00000100:00100000:3.0:1787707320.200953:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2362:x1874546707685888:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707320.201018:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2362:x1874546707685888:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 67us (1828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707320.201025:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 72 00000100:00100000:2.0:1787707320.201183:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707686016 00000100:00100000:2.0:1787707320.201188:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707686016 00000100:00100000:2.0:1787707320.201230:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 132 00000100:00100000:2.0:1787707320.201238:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2361:x1874546707686016:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707320.201266:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2361:x1874546707686016:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 29us (2108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707320.201272:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 132 00000100:00080000:0.0:1787707320.201806:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787707320.201811:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787707320.205432:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707685632 00000100:00100000:1.0:1787707320.205448:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707685632 00000100:00100000:1.0:1787707320.205537:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 284 00000100:00100000:1.0:1787707320.205548:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:2362:x1874546707685632:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707320.205779:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:2362:x1874546707685632:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 232us (7321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707320.205787:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 284 00010000:00010000:1.0:1787707320.572021:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707321.596941:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707321.657130:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729745152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787707321.657249:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707321.657550:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729745152 00000100:00100000:1.0:1787707321.657565:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729745152 00000100:00100000:1.0:1787707321.657665:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787707321.657688:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729745152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787707321.657743:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787707321.657816:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729745152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707321.657843:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787707321.657951:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729745152:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787707321.658123:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787707322.616599:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707323.640558:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707323.705947:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874546729745536:0@lo:400:kworker.0 00000100:00100000:0.0:1787707323.706020:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707323.706096:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787707323.706102:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729745408:0@lo:400:kworker.0 00000100:00100000:0.0:1787707323.706125:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707323.706139:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729745920:0@lo:400:kworker.0 00000100:00100000:0.0:1787707323.706161:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707323.706283:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729745920 00000100:00100000:3.0:1787707323.706292:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729745920 00000100:00100000:3.0:1787707323.706353:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787707323.706364:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729745920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707323.706450:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729745920:12345-0@lo:400:kworker.0 Request processed in 88us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707323.706458:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787707323.706483:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729745280:0@lo:400:kworker.0 00000100:00100000:3.0:1787707323.706512:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707323.706544:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874546729745792:0@lo:400:kworker.0 00000100:00100000:3.0:1787707323.706564:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707323.706580:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787707323.706586:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729745664:0@lo:400:kworker.0 00000100:00100000:3.0:1787707323.706606:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787707323.706645:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa2f053800 x1874546729745920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707323.706658:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729745920:0@lo:400:kworker.0 00000100:00100000:3.0:1787707323.706680:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729745664 00000100:00100000:3.0:1787707323.706683:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729745664 00000100:00100000:3.0:1787707323.706708:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787707323.706714:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729745664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707323.706748:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729745664:12345-0@lo:400:kworker.0 Request processed in 34us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707323.706754:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787707323.706788:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729745664:0@lo:400:kworker.0 00000100:00080000:0.0:1787707323.707258:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787707323.707264:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787707323.707363:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729745536 00000100:00100000:2.0:1787707323.707424:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729745536 00000100:00100000:2.0:1787707323.707455:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729745408 00000100:00100000:2.0:1787707323.707459:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729745408 00000100:00100000:2.0:1787707323.707471:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729745792 00000100:00100000:2.0:1787707323.707473:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729745792 00000100:00100000:2.0:1787707323.707486:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787707323.707493:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874546729745536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707323.707548:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874546729745536:12345-0@lo:400:kworker.0 Request processed in 55us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707323.707555:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787707323.707568:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787707323.707574:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729745408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707323.707599:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729745408:12345-0@lo:400:kworker.0 Request processed in 26us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707323.707605:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787707323.707614:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787707323.707619:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874546729745792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707323.707646:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874546729745792:12345-0@lo:400:kworker.0 Request processed in 26us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707323.707651:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787707323.707672:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729745280 00000100:00100000:2.0:1787707323.707675:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729745280 00000100:00100000:2.0:1787707323.707699:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787707323.707706:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3317:x1874546729745280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707323.707734:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3317:x1874546729745280:12345-0@lo:400:kworker.0 Request processed in 29us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707323.707740:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787707323.707804:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729745280:0@lo:400:kworker.0 00000100:00100000:2.0:1787707323.707816:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874546729745792:0@lo:400:kworker.0 00000100:00100000:3.0:1787707323.708136:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729745408:0@lo:400:kworker.0 00000100:00100000:3.0:1787707323.708148:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874546729745536:0@lo:400:kworker.0 00000100:00080000:0.0:1787707323.708394:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787707324.218087:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729746048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787707324.218162:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707324.218270:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729746048 00000100:00100000:0.0:1787707324.218279:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729746048 00000100:00100000:0.0:1787707324.218332:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787707324.218342:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729746048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787707324.218417:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707324.218461:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729746048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707324.218467:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1787707324.218920:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa2f050a80 x1874546729746048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707324.218940:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729746048:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787707324.664702:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707325.320204:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707325.320253:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707325.320298:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707325.320338:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707325.320439:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707686144 00000100:00100000:3.0:1787707325.320449:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707686144 00000100:00100000:3.0:1787707325.320513:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 286 00000100:00100000:1.0:1787707325.320520:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707686272 00000100:00100000:3.0:1787707325.320523:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:2361:x1874546707686144:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707325.320524:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707686272 00000100:00100000:1.0:1787707325.320561:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707686528 00000100:00100000:1.0:1787707325.320564:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707686528 00000100:00100000:1.0:1787707325.320579:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 136 00000100:00100000:1.0:1787707325.320586:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2361:x1874546707686272:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707325.320588:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:2361:x1874546707686144:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 68us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707325.320595:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 286 00000100:00100000:1.0:1787707325.320616:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2361:x1874546707686272:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 32us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707325.320623:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 136 00000100:00100000:3.0:1787707325.320631:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707686400 00000100:00100000:3.0:1787707325.320634:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707686400 00000100:00100000:1.0:1787707325.320637:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 137 00000100:00100000:1.0:1787707325.320642:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2361:x1874546707686528:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707325.320661:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 75 00000100:00100000:1.0:1787707325.320663:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2361:x1874546707686528:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 21us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707325.320669:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 137 00000100:00080000:0.0:1787707325.320766:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787707325.320770:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707325.320800:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f051180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2361:x1874546707686400:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707325.321136:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f051180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2361:x1874546707686400:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 467us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707325.321144:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 75 00010000:00010000:3.0:1787707325.688641:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787707326.268826:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787707326.715606:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707326.776628:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787707326.776662:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729746176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787707326.776737:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707326.776958:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729746176 00000100:00100000:0.0:1787707326.776966:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729746176 00000100:00100000:0.0:1787707326.777087:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787707326.777098:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729746176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787707326.777132:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707326.777199:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729746176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707326.777220:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1787707326.777410:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787707326.777546:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729746176:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787707327.736703:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707328.760811:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707328.832765:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729746304:0@lo:400:kworker.0 00000100:00100000:1.0:1787707328.832846:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707328.832914:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874546729746816:0@lo:400:kworker.0 00000100:00100000:1.0:1787707328.832944:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707328.832972:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787707328.832979:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729746688:0@lo:400:kworker.0 00000100:00100000:1.0:1787707328.833014:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707328.833047:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729746304 00000100:00100000:1.0:1787707328.833055:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729746304 00000100:00100000:1.0:1787707328.833098:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787707328.833108:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3317:x1874546729746304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707328.833156:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3317:x1874546729746304:12345-0@lo:400:kworker.0 Request processed in 49us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707328.833163:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787707328.833208:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729746816 00000100:00100000:1.0:1787707328.833212:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729746816 00000100:00100000:1.0:1787707328.833242:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787707328.833248:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874546729746816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707328.833274:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874546729746816:12345-0@lo:400:kworker.0 Request processed in 27us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707328.833280:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787707328.833296:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729746688 00000100:00100000:1.0:1787707328.833300:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729746688 00000100:00100000:1.0:1787707328.833336:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787707328.833342:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729746688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707328.833404:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729746688:12345-0@lo:400:kworker.0 Request processed in 28us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707328.833411:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787707328.833449:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729746688:0@lo:400:kworker.0 00000100:00100000:1.0:1787707328.833467:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729746304:0@lo:400:kworker.0 00000100:00100000:1.0:1787707328.833674:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874546729746816:0@lo:400:kworker.0 00000100:00100000:2.0:1787707328.833780:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874546729746560:0@lo:400:kworker.0 00000100:00100000:2.0:1787707328.833813:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707328.833846:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787707328.833853:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729746432:0@lo:400:kworker.0 00000100:00100000:2.0:1787707328.833873:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707328.833891:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729746944:0@lo:400:kworker.0 00000100:00100000:2.0:1787707328.833911:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707328.833934:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729746944 00000100:00100000:2.0:1787707328.833937:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729746944 00000100:00100000:2.0:1787707328.833965:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787707328.833972:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729746944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707328.834020:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729746944:12345-0@lo:400:kworker.0 Request processed in 48us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707328.834026:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787707328.834045:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729746560 00000100:00100000:2.0:1787707328.834048:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729746560 00000100:00100000:2.0:1787707328.834075:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729746432 00000100:00100000:2.0:1787707328.834077:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729746432 00000100:00100000:2.0:1787707328.834089:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787707328.834095:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874546729746560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707328.834125:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874546729746560:12345-0@lo:400:kworker.0 Request processed in 30us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707328.834131:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787707328.834143:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787707328.834148:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729746432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707328.834172:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729746432:12345-0@lo:400:kworker.0 Request processed in 25us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707328.834177:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1787707328.834208:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787707328.834212:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787707328.834215:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787707328.834232:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729746432:0@lo:400:kworker.0 00010000:00080000:2.0:1787707328.834243:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3ac52680 x1874546729746944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707328.834253:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729746944:0@lo:400:kworker.0 00000100:00100000:2.0:1787707328.834263:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874546729746560:0@lo:400:kworker.0 00000100:00100000:2.0:1787707329.337727:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729747072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787707329.337799:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707329.339474:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729747072 00000100:00100000:3.0:1787707329.339487:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729747072 00000100:00100000:3.0:1787707329.339552:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787707329.339562:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729747072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787707329.339600:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707329.339675:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729747072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (1877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707329.339695:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1787707329.339832:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa2f050380 x1874546729747072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707329.339853:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729747072:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787707329.787246:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707330.439693:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707330.439746:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707330.439814:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707686784 00000100:00100000:0.0:1787707330.439824:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707686784 00000100:00100000:0.0:1787707330.439905:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 141 00000100:00100000:0.0:1787707330.439916:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2362:x1874546707686784:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707330.439985:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2362:x1874546707686784:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 72us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707330.439993:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 141 00000100:00080000:1.0:1787707330.444934:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787707330.445697:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707686656 00000100:00100000:2.0:1787707330.445710:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707686656 00000100:00100000:2.0:1787707330.445778:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 288 00000100:00100000:2.0:1787707330.445788:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+13:2362:x1874546707686656:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707330.445886:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+13:2362:x1874546707686656:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 91us (6193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707330.445895:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 288 00000100:00100000:3.0:1787707330.452351:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707330.452507:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707330.452670:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707686912 00000100:00100000:1.0:1787707330.452680:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707686912 00000100:00100000:1.0:1787707330.452751:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 19 00000100:00100000:1.0:1787707330.452762:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2358:x1874546707686912:12345-192.168.204.46@tcp:9:kworker.0 00000020:00000080:1.0:1787707330.452793:0:8265:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec0abf 00000100:00080000:1.0:1787707330.452803:0:8265:0:(import.c:65:import_set_state_nolock()) ffff8cfa3cba8800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787707330.452838:0:8265:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1787707330.453127:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+2:2358:x1874546707686912:12345-192.168.204.46@tcp:9:kworker.0 Request processed in 354us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707330.453136:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 19 00010000:00010000:1.0:1787707330.453163:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707330.453705:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707687040 00000100:00100000:2.0:1787707330.453711:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707687040 00000100:00100000:2.0:1787707330.453754:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 142 00000100:00100000:2.0:1787707330.453763:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2361:x1874546707687040:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707330.453805:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2361:x1874546707687040:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 44us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707330.453812:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 142 00000100:00080000:3.0:1787707330.454113:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787707330.454131:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787707330.814261:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707331.832874:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707331.896695:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729747200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787707331.896773:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707331.896986:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729747200 00000100:00100000:2.0:1787707331.896995:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729747200 00000100:00100000:2.0:1787707331.897053:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787707331.897062:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729747200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787707331.897096:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707331.897143:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729747200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707331.897150:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787707331.897190:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729747200:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787707331.897735:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1787707332.529905:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9ed4058d-c366-401f-b84d-540fc0489f0c 00000020:00000080:3.0:1787707332.529914:0:6712:0:(genops.c:885:class_export_put()) final put ffff8cfa3cba8000/9ed4058d-c366-401f-b84d-540fc0489f0c 00000020:00000080:0.0:1787707332.531957:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa3cba8000/9ed4058d-c366-401f-b84d-540fc0489f0c for lustre-OST0000 00000020:00000080:0.0:1787707332.532108:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfa3cba8800 for lustre-OST0000 00010000:00010000:1.0:1787707332.858463:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707333.883207:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707333.945244:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729747328:0@lo:400:kworker.0 00000100:00100000:1.0:1787707333.945331:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707333.945416:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729747328 00000100:00100000:3.0:1787707333.945430:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729747328 00000100:00100000:1.0:1787707333.945443:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874546729747840:0@lo:400:kworker.0 00000100:00100000:1.0:1787707333.945489:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707333.945509:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787707333.945524:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3317:x1874546729747328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707333.945525:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787707333.945551:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f051f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729747712:0@lo:400:kworker.0 00000100:00100000:1.0:1787707333.945590:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707333.945636:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3317:x1874546729747328:12345-0@lo:400:kworker.0 Request processed in 115us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707333.945644:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3317:1874546729747328:0@lo:400:kworker.0 00000100:00100000:3.0:1787707333.945653:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787707333.945693:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729747456:0@lo:400:kworker.0 00000100:00100000:1.0:1787707333.945741:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707333.945767:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729747968:0@lo:400:kworker.0 00000100:00100000:1.0:1787707333.945790:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707333.945818:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787707333.945820:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729747840 00000100:00100000:3.0:1787707333.945827:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729747840 00000100:00100000:1.0:1787707333.945828:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729747584:0@lo:400:kworker.0 00000100:00100000:1.0:1787707333.945868:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707333.946076:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729747712 00000100:00100000:0.0:1787707333.946082:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729747712 00000100:00100000:0.0:1787707333.946130:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729747968 00000100:00100000:0.0:1787707333.946133:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729747968 00000100:00100000:0.0:1787707333.946156:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787707333.946165:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729747712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707333.946235:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729747712:12345-0@lo:400:kworker.0 Request processed in 71us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707333.946241:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787707333.946255:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787707333.946261:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729747968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707333.946299:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729747968:12345-0@lo:400:kworker.0 Request processed in 38us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707333.946305:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1787707333.946343:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787707333.946348:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787707333.946362:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707333.946433:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f051f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729747712:0@lo:400:kworker.0 00010000:00080000:0.0:1787707333.946472:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa2f051500 x1874546729747968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707333.946483:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729747968:0@lo:400:kworker.0 00000100:00100000:3.0:1787707333.953975:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729747456 00000100:00100000:3.0:1787707333.953995:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729747456 00000100:00100000:3.0:1787707333.954045:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729747584 00000100:00100000:3.0:1787707333.954049:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729747584 00000100:00100000:3.0:1787707333.954089:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787707333.954116:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874546729747840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707333.954505:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874546729747840:12345-0@lo:400:kworker.0 Request processed in 391us (9014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707333.954525:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787707333.954547:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787707333.954625:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729747456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707333.954670:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729747456:12345-0@lo:400:kworker.0 Request processed in 117us (8928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707333.954676:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787707333.954688:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787707333.954695:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729747584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707333.954722:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729747584:12345-0@lo:400:kworker.0 Request processed in 28us (8859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707333.954728:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1787707333.954780:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707333.954828:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729747584:0@lo:400:kworker.0 00000100:00100000:3.0:1787707333.954843:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729747456:0@lo:400:kworker.0 00000100:00100000:3.0:1787707333.954887:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874546729747840:0@lo:400:kworker.0 00000100:00100000:3.0:1787707334.457110:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787707334.457138:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729748096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787707334.457231:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707334.457422:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729748096 00000100:00100000:0.0:1787707334.457431:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729748096 00000100:00100000:0.0:1787707334.457481:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787707334.457765:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729748096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787707334.457862:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707334.457930:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729748096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 439us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707334.457936:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1787707334.458201:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa2f051500 x1874546729748096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707334.458232:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729748096:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787707334.909314:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707335.560781:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707335.565263:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707335.565308:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707335.566723:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707687168 00000100:00100000:1.0:1787707335.566736:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707687168 00000100:00100000:1.0:1787707335.566795:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 290 00000100:00100000:1.0:1787707335.566807:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:2360:x1874546707687168:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707335.566879:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:2360:x1874546707687168:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 74us (1626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707335.566886:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 290 00000100:00100000:2.0:1787707335.577271:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707687296 00000100:00100000:2.0:1787707335.577288:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707687296 00000100:00100000:2.0:1787707335.577417:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707687424 00000100:00100000:2.0:1787707335.577421:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707687424 00000100:00100000:2.0:1787707335.577456:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 146 00000100:00100000:2.0:1787707335.577466:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2360:x1874546707687296:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707335.577575:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2360:x1874546707687296:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 100us (16792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707335.577583:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 146 00000100:00100000:2.0:1787707335.577604:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 147 00000100:00100000:2.0:1787707335.577610:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2360:x1874546707687424:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707335.577633:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2360:x1874546707687424:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 24us (12326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707335.577639:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 147 00000100:00080000:3.0:1787707335.578009:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787707335.933867:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787707336.509316:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787707336.955741:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707337.017992:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787707337.018019:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729748224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787707337.018097:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707337.018176:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729748224 00000100:00100000:2.0:1787707337.018183:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729748224 00000100:00100000:2.0:1787707337.018239:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787707337.018249:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729748224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787707337.018284:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707337.018328:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729748224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707337.018335:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1787707337.018360:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787707337.018411:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729748224:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787707337.976623:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787707338.980752:0:11855:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 21:22:16 (1787707336) 00010000:00010000:1.0:1787707339.001690:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707339.070138:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2a590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729748736:0@lo:400:kworker.0 00000100:00100000:1.0:1787707339.070218:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707339.070286:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787707339.070293:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729748352:0@lo:400:kworker.0 00000100:00100000:1.0:1787707339.070389:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707339.070424:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2a591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874546729748864:0@lo:400:kworker.0 00000100:00100000:1.0:1787707339.070473:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707339.070502:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729748480:0@lo:400:kworker.0 00000100:00100000:1.0:1787707339.070531:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707339.070549:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2a593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729748992:0@lo:400:kworker.0 00000100:00100000:1.0:1787707339.070569:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707339.070588:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787707339.070593:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2a592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729748608:0@lo:400:kworker.0 00000100:00100000:1.0:1787707339.070616:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707339.070647:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729748736 00000100:00100000:1.0:1787707339.070654:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729748736 00000100:00100000:1.0:1787707339.070704:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729748992 00000100:00100000:1.0:1787707339.070707:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729748992 00000100:00100000:1.0:1787707339.070732:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787707339.070739:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729748736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707339.070793:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729748736:12345-0@lo:400:kworker.0 Request processed in 53us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707339.070801:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787707339.070824:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787707339.070831:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a591880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729748992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707339.070928:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a591880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729748992:12345-0@lo:400:kworker.0 Request processed in 97us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707339.070935:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787707339.070957:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729748352 00000100:00100000:1.0:1787707339.070961:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729748352 00000100:00100000:1.0:1787707339.070986:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787707339.070992:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3316:x1874546729748352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707339.071032:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3316:x1874546729748352:12345-0@lo:400:kworker.0 Request processed in 40us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707339.071039:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787707339.071070:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729748864 00000100:00100000:1.0:1787707339.071074:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729748864 00000100:00100000:1.0:1787707339.071101:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729748480 00000100:00100000:1.0:1787707339.071104:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729748480 00000100:00100000:1.0:1787707339.071127:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729748608 00000100:00100000:1.0:1787707339.071130:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729748608 00000100:00100000:1.0:1787707339.071149:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787707339.071155:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874546729748864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707339.071185:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874546729748864:12345-0@lo:400:kworker.0 Request processed in 30us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707339.071192:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787707339.071204:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787707339.071210:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729748480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707339.071233:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729748480:12345-0@lo:400:kworker.0 Request processed in 24us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707339.071239:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787707339.071249:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787707339.071255:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729748608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707339.071277:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729748608:12345-0@lo:400:kworker.0 Request processed in 22us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707339.071282:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1787707339.071311:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787707339.071316:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787707339.071318:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787707339.071404:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729748352:0@lo:400:kworker.0 00000100:00100000:1.0:1787707339.071421:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2a591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874546729748864:0@lo:400:kworker.0 00000100:00100000:1.0:1787707339.071429:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2a590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729748736:0@lo:400:kworker.0 00010000:00080000:3.0:1787707339.071644:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa2a593480 x1874546729748992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787707355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707339.071656:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2a593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729748992:0@lo:400:kworker.0 00000100:00100000:3.0:1787707339.071672:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2a592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729748608:0@lo:400:kworker.0 00000100:00100000:3.0:1787707339.071682:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729748480:0@lo:400:kworker.0 00000100:00100000:3.0:1787707339.577320:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787707339.577360:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729749120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787707339.577664:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707339.578187:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729749120 00000100:00100000:2.0:1787707339.578202:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729749120 00000100:00100000:2.0:1787707339.578280:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787707339.578292:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729749120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787707339.578333:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707339.578464:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729749120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 174us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707339.578471:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1787707339.578623:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa2f052680 x1874546729749120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707339.578647:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729749120:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787707340.026464:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707340.700485:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707340.700539:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707340.700638:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707687552 00000100:00100000:3.0:1787707340.700649:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707687552 00000100:00100000:3.0:1787707340.700710:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 292 00000100:00100000:3.0:1787707340.700720:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:2361:x1874546707687552:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707340.700793:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:2361:x1874546707687552:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 74us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707340.700801:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 292 00000100:00100000:1.0:1787707340.701339:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707340.712687:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707687808 00000100:00100000:2.0:1787707340.712702:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707687808 00000100:00100000:2.0:1787707340.712883:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707687680 00000100:00100000:2.0:1787707340.712887:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707687680 00000100:00100000:3.0:1787707340.712946:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 151 00000100:00100000:3.0:1787707340.712961:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2361:x1874546707687808:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707340.713062:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2361:x1874546707687808:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 105us (12522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707340.713104:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 151 00000100:00080000:1.0:1787707340.721642:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787707340.721887:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 152 00000100:00100000:2.0:1787707340.721903:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2361:x1874546707687680:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707340.722022:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2361:x1874546707687680:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 124us (20683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707340.722030:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 152 00000100:00100000:1.0:1787707340.940739:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707340.940861:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707687936 00000100:00100000:3.0:1787707340.940876:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707687936 00000100:00100000:3.0:1787707340.940958:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 32 00000100:00100000:3.0:1787707340.940972:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+5:10263:x1874546707687936:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787707340.941003:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707340.941193:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec0b8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9c9d expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707340.941305:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0b91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707340.941321:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0b91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707340.941335:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0b91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707340.941615:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787707340.941620:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787707340.941735:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0b91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707340.941768:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec0b8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c9d expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707340.941787:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0b91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c9d expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707340.941809:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa143e4a00) 00010000:00010000:3.0:1787707340.941812:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787707340.941816:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fca00, rc 0) 00000100:00100000:3.0:1787707340.941976:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:10263:x1874546707687936:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 1006us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707340.941985:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 32 00000100:00100000:3.0:1787707340.952744:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707340.953185:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707688064 00000100:00100000:2.0:1787707340.953196:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707688064 00000100:00100000:2.0:1787707340.953262:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 33 00000100:00100000:2.0:1787707340.953272:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+6:10264:x1874546707688064:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787707340.953293:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707340.953313:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0b98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9ca4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.953570:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0b9f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.953597:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0b9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.953607:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0b9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.953621:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0ba6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.953627:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.953634:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.954616:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a200/0xc5f18d5f94ec0bad lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.954633:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a200/0xc5f18d5f94ec0bad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.954644:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a200/0xc5f18d5f94ec0bad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707340.954739:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787707340.954744:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787707340.954825:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a200/0xc5f18d5f94ec0bad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.954837:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0b9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.954854:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0b9f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.954861:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0b9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.954872:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707340.954876:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0b9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.954883:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0b9f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.954896:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa143e4a00) 00010000:00010000:2.0:1787707340.954899:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707340.954904:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0b9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.954909:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0b9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.954921:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.954927:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0ba6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.954933:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.954937:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707340.954946:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.954952:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0ba6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.955156:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cfa12a49300) 00010000:00010000:2.0:1787707340.955160:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707340.955163:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0ba6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.955169:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0ba6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.955208:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0b98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ca4 expref: 8 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.955221:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a200/0xc5f18d5f94ec0bad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ca4 expref: 7 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707340.955228:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cfa12a49100) 00010000:00010000:2.0:1787707340.955231:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787707340.955233:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871a200, rc 0) 00000100:00100000:2.0:1787707340.955314:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+7:10264:x1874546707688064:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 2043us (2578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707340.955323:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 33 00000100:00100000:0.0:1787707340.961991:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707340.962137:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707688320 00000100:00100000:1.0:1787707340.962148:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707688320 00000100:00100000:1.0:1787707340.962235:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 34 00000100:00100000:1.0:1787707340.962246:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+7:10264:x1874546707688320:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787707340.962267:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707340.962287:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0bb4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9cab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.962355:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0bbb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.962397:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0bbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.962407:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0bbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.962470:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0bc2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.962478:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.962500:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.963524:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5400/0xc5f18d5f94ec0bc9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.963538:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5400/0xc5f18d5f94ec0bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.963547:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5400/0xc5f18d5f94ec0bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707340.963558:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787707340.963797:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0bbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.963806:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0bbb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.963813:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0bbb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.963820:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d5e00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707340.963824:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0bbb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.963830:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0bbb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.963841:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cfa12a49100) 00010000:00010000:1.0:1787707340.963844:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707340.963934:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0bbb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.963942:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0bbb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.963956:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.963961:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0bc2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.963967:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.963972:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d5600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707340.963975:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.963980:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.963987:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cfa06897400) 00010000:00010000:1.0:1787707340.963989:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707340.963992:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0bc2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.963997:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0bc2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.964580:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0bb4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cab expref: 10 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.964609:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5400/0xc5f18d5f94ec0bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cab expref: 9 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707340.964617:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfa06897a00) 00010000:00010000:1.0:1787707340.964620:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707340.964622:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d5400, rc 0) 00000100:00100000:1.0:1787707340.964691:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+9:10264:x1874546707688320:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 2445us (2709us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787707340.964700:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 34 00000100:00100000:1.0:1787707340.967910:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707340.968196:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707688448 00000100:00100000:0.0:1787707340.968206:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707688448 00000100:00100000:0.0:1787707340.968261:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 35 00000100:00100000:0.0:1787707340.968275:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+9:10264:x1874546707688448:12345-192.168.204.46@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787707340.968992:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+9:10264:x1874546707688448:12345-192.168.204.46@tcp:59:lhsmtool_posix.0 Request processed in 718us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707340.969001:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 35 00010000:00010000:1.0:1787707341.049068:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787707341.627659:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787707342.072888:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707342.154222:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787707342.154247:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729749248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787707342.154345:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707342.154738:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729749248 00000100:00100000:3.0:1787707342.154747:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729749248 00000100:00100000:3.0:1787707342.154808:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787707342.154819:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06f6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729749248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787707342.154855:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707342.154907:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06f6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729749248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707342.154914:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787707342.155146:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729749248:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787707342.155361:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787707342.726787:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:0.0:1787707343.097874:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707343.371865:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707343.372012:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707688576 00000100:00100000:1.0:1787707343.372023:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707688576 00000100:00100000:1.0:1787707343.372104:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 36 00000100:00100000:1.0:1787707343.372116:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+8:10307:x1874546707688576:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:1.0:1787707343.372135:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707343.372154:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0bd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9cb2 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372214:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0bde lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372229:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0bde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372253:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0bde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372268:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0be5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372275:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0be5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372282:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0be5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787707343.372575:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787707343.372687:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0bde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372696:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0bde lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372703:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0bde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372709:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d5600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707343.372714:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0bde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372723:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0bde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372735:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa143e4a00) 00010000:00010000:1.0:1787707343.372738:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707343.372743:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0bde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372754:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0bde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372767:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0be5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372774:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0be5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372780:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0be5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372785:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707343.372789:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0be5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372795:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0be5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372802:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cfa06897700) 00010000:00010000:1.0:1787707343.372805:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707343.372808:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0be5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372814:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0be5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372846:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0bd7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cb2 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372868:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa143e4a00) 00010000:00010000:1.0:1787707343.372871:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707343.372875:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0bd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cb2 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.372885:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d5e00, rc 0) 00000100:00100000:1.0:1787707343.373102:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+8:10307:x1874546707688576:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 987us (1246us total) trans 0 rc 301/301 00000100:00100000:1.0:1787707343.373110:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 36 00000100:00100000:2.0:1787707343.400239:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707343.402510:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707688832 00000100:00100000:0.0:1787707343.402526:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707688832 00000100:00100000:0.0:1787707343.402590:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 37 00000100:00100000:0.0:1787707343.402603:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+8:10307:x1874546707688832:12345-192.168.204.46@tcp:36:lfs.0 00010000:00010000:0.0:1787707343.402660:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707343.402691:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0b91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c9d expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707343.402711:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa143e4a00) 00010000:00010000:0.0:1787707343.402723:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787707343.403329:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0bec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707343.403343:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0bec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707343.403354:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0bec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707343.403365:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0bf3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707343.404068:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707343.404078:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707343.412805:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787707343.412824:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0bec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707343.412836:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0bec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707343.412844:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0bec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707343.412851:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707343.412855:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0bec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707343.412863:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0bec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707343.412881:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa19f4e900) 00010000:00010000:0.0:1787707343.412884:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707343.412889:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0bec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707343.412894:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0bec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787707343.414011:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030395db5 reply state 00000000729d4d27 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707343.414026:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787707343.414167:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+9:10307:x1874546707688832:12345-192.168.204.46@tcp:36:lfs.0 Request processed in 11564us (13932us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787707343.414189:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 37 00010000:00010000:0.0:1787707343.420924:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707343.420943:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0bf3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707343.420951:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0bf3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707343.420957:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707343.420962:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0bf3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707343.420969:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0bf3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707343.420986:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cfa19f4ed00) 00010000:00010000:0.0:1787707343.420989:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707343.420994:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0bf3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707343.420999:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0bf3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707343.529978:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707343.530111:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707688960 00000100:00100000:1.0:1787707343.530122:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707688960 00000100:00100000:1.0:1787707343.530181:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 38 00000100:00100000:1.0:1787707343.530191:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+8:10315:x1874546707688960:12345-192.168.204.46@tcp:101:lctl.0 00010000:00010000:1.0:1787707343.530213:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707343.530233:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0bfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9cb9 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.530294:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0c01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.530306:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0c01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.530316:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0c01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707343.530423:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787707343.530434:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787707343.530480:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0c01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.530521:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0bfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cb9 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.530538:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0c01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cb9 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.530547:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa06897700) 00010000:00010000:1.0:1787707343.530549:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787707343.530552:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d5600, rc 0) 00000100:00100000:1.0:1787707343.530610:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+9:10315:x1874546707688960:12345-192.168.204.46@tcp:101:lctl.0 Request processed in 419us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707343.530616:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 38 00000100:00100000:0.0:1787707343.646754:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707343.646974:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707689088 00000100:00100000:2.0:1787707343.646985:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707689088 00000100:00100000:2.0:1787707343.647054:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 39 00000100:00100000:2.0:1787707343.647066:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+9:10321:x1874546707689088:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:2.0:1787707343.647086:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707343.647109:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec0c08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9cc0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647192:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0c0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647207:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0c0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647219:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0c0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647235:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0c16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647242:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0c16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647249:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0c16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647358:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a000/0xc5f18d5f94ec0c1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647367:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a000/0xc5f18d5f94ec0c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647421:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a000/0xc5f18d5f94ec0c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707343.647455:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787707343.647459:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787707343.647516:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a000/0xc5f18d5f94ec0c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647529:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0c0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647536:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0c0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647544:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0c0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647550:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871a800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707343.647555:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0c0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647562:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0c0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647575:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa06897700) 00010000:00010000:2.0:1787707343.647578:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707343.647582:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0c0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647589:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0c0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647613:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0c16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647619:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0c16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647626:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0c16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647632:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871a600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707343.647634:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0c16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647641:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0c16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647649:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cfa12a49700) 00010000:00010000:2.0:1787707343.647651:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707343.647654:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0c16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647660:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0c16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647693:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec0c08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cc0 expref: 11 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647707:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a000/0xc5f18d5f94ec0c1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cc0 expref: 10 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.647726:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:2.0:1787707343.647728:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787707343.647731:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871a000, rc 0) 00000100:00100000:2.0:1787707343.647804:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+10:10321:x1874546707689088:12345-192.168.204.46@tcp:101:bash.0 Request processed in 740us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707343.647812:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 39 00000100:00100000:3.0:1787707343.651462:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707343.652022:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707689344 00000100:00100000:1.0:1787707343.652045:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707689344 00000100:00100000:1.0:1787707343.652114:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 40 00000100:00100000:1.0:1787707343.652125:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+10:10321:x1874546707689344:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:1.0:1787707343.652145:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707343.652167:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0c24 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9cc7 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.652493:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0c2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.652507:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0c2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.652537:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0c2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.652583:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0c32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.652592:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0c32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.652598:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0c32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787707343.659355:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1787707343.660474:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0c39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.660493:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0c39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.660505:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0c39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.660540:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0c2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.660546:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0c2b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.660552:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0c2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.660558:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d5a00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707343.660575:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0c2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.660582:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0c2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.660594:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:1.0:1787707343.660596:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707343.660601:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0c2b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.660607:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0c2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787707343.660621:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097341d32 reply state 0000000024afa0af transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0c32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707343.660642:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787707343.660676:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0c24 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cc7 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.660692:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0c39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cc7 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.660699:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa06897500) 00010000:00010000:1.0:1787707343.660701:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787707343.660704:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d5000, rc 0) 00000100:00100000:1.0:1787707343.660784:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+13:10321:x1874546707689344:12345-192.168.204.46@tcp:101:bash.0 Request processed in 8660us (9331us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787707343.660793:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 40 00010000:00010000:2.0:1787707343.668435:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0c32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.668451:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0c32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.668459:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0c32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.668465:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d5e00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707343.668470:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0c32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.668478:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0c32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.668496:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cfa06897400) 00010000:00010000:2.0:1787707343.668499:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707343.668504:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0c32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.668510:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0c32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707343.680297:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707343.680550:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707689472 00000100:00100000:1.0:1787707343.680563:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707689472 00000100:00100000:1.0:1787707343.680641:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 20 00000100:00100000:1.0:1787707343.680650:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1874546707689472:12345-192.168.204.46@tcp:8:bash.0 00010000:00080000:1.0:1787707343.680683:0:6689:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-OST0001: connection from 9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp t0 exp 0000000000000000 cur 394 last 0 00000020:00000080:1.0:1787707343.680716:0:6689:0:(genops.c:1385:class_connect()) connect: client 9ed4058d-c366-401f-b84d-540fc0489f0c, cookie 0xc5f18d5f94ec0c47 00002000:00100000:1.0:1787707343.680728:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9ed4058d-c366-401f-b84d-540fc0489f0c/ffff8cfa05843000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787707343.680753:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787707343.680992:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787707343.681026:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8cfa05840000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787707343.681129:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2358:x1874546707689472:12345-192.168.204.46@tcp:8:bash.0 Request processed in 478us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707343.681137:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 20 00000100:00100000:3.0:1787707343.688671:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707343.688750:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707689600 00000100:00100000:1.0:1787707343.688761:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707689600 00000100:00100000:1.0:1787707343.688849:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 21 00000100:00100000:1.0:1787707343.688861:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:0:x1874546707689600:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:1.0:1787707343.688878:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707343.688903:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031dece36/0xc5f18d5f94ec0c4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9cce expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787707343.688931:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787707343.688949:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=394s v=(0 0) 00010000:00010000:1.0:1787707343.688954:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707343.688965:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031dece36/0xc5f18d5f94ec0c4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cce expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.689008:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000031dece36/0xc5f18d5f94ec0c4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cce expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.689022:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d4000, rc 0) 00000100:00100000:1.0:1787707343.689223:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+7:0:x1874546707689600:12345-192.168.204.46@tcp:101:bash.0 Request processed in 363us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707343.689230:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 21 00000100:00080000:2.0:1787707343.689813:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787707343.695905:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707343.696021:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707689728 00000100:00100000:1.0:1787707343.696042:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707689728 00000100:00100000:1.0:1787707343.696098:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 22 00000100:00100000:1.0:1787707343.696109:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+7:10321:x1874546707689728:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:1.0:1787707343.696126:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707343.696144:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f83de57/0xc5f18d5f94ec0c55 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9cd5 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.696177:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000031dece36/0xc5f18d5f94ec0c4e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cce expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.696186:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707343.696191:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707343.696197:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f83de57/0xc5f18d5f94ec0c55 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cd5 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.696231:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000031dece36/0xc5f18d5f94ec0c4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cce expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.696258:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000031dece36/0xc5f18d5f94ec0c4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cce expref: 8 pid: 6690 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707343.696273:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2a593100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1874546729749376:192.168.204.46@tcp:104: 00000100:00100000:1.0:1787707343.696606:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05edb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707343.701865:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707343.701962:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707689856 00000100:00100000:2.0:1787707343.701972:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707689856 00010000:00010000:2.0:1787707343.702014:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000031dece36/0xc5f18d5f94ec0c4e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cce expref: 9 pid: 6690 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707343.702065:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 35 00000100:00100000:2.0:1787707343.702077:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f053480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+9:2361:x1874546707689856:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787707343.702092:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707343.702115:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000031dece36/0xc5f18d5f94ec0c4e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cce expref: 9 pid: 6690 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.702130:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000031dece36/0xc5f18d5f94ec0c4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cce expref: 9 pid: 6690 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.702156:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707343.702161:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707343.702168:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007f83de57/0xc5f18d5f94ec0c55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cd5 expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.702178:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f83de57/0xc5f18d5f94ec0c55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cd5 expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.702213:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007f83de57/0xc5f18d5f94ec0c55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cd5 expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707343.702240:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5843:1874546729749504:192.168.204.46@tcp:105: 00000100:00100000:2.0:1787707343.702326:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa10388c00 going to sleep for 11 seconds 00010000:00010000:1.0:1787707343.702635:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031dece36/0xc5f18d5f94ec0c4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cce expref: 9 pid: 6690 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707343.702651:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2a593100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1874546729749376:192.168.204.46@tcp:104: 00010000:00010000:1.0:1787707343.702674:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007f83de57/0xc5f18d5f94ec0c55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cd5 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707343.702685:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d5a00, rc 0) 00000100:00100000:1.0:1787707343.702719:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+8:10321:x1874546707689728:12345-192.168.204.46@tcp:101:bash.0 Request processed in 6612us (6824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707343.702727:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 22 00000100:00100000:0.0:1787707343.716075:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707343.717271:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5843:1874546729749504:192.168.204.46@tcp:105: 00010000:00010000:2.0:1787707343.717297:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707343.717411:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f053480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2361:x1874546707689856:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 15334us (15552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707343.717424:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 35 00000100:00100000:3.0:1787707343.717991:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707690112 00000100:00100000:3.0:1787707343.718000:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707690112 00000100:00100000:3.0:1787707343.718070:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 6 00000100:00100000:3.0:1787707343.718080:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+12:10321:x1874546707690112:12345-192.168.204.46@tcp:35:bash.0 00000100:00100000:2.0:1787707343.720156:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+13:10321:x1874546707690112:12345-192.168.204.46@tcp:35:bash.0 Request processed in 2069us (4082us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787707343.720173:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 6 00000100:00100000:0.0:1787707343.877817:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707343.877990:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707690368 00000100:00100000:2.0:1787707343.877999:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707690368 00000100:00100000:2.0:1787707343.878080:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 41 00000100:00100000:2.0:1787707343.878091:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+13:10331:x1874546707690368:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:2.0:1787707343.878116:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707343.878138:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0c5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9cdc expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707343.878263:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787707343.878416:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0c5c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cdc expref: 15 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.878431:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa06897700) 00010000:00010000:2.0:1787707343.878435:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787707343.878454:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0c5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cdc expref: 15 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707343.878468:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871a600, rc 0) 00000100:00100000:2.0:1787707343.878549:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+14:10331:x1874546707690368:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 459us (743us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1787707343.878556:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 41 00000100:00100000:3.0:1787707343.887812:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707343.887943:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707690624 00000100:00100000:0.0:1787707343.887959:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707690624 00000100:00100000:0.0:1787707343.888043:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 7 00000100:00100000:0.0:1787707343.888054:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+14:10331:x1874546707690624:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:0.0:1787707343.888337:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+15:10331:x1874546707690624:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 284us (534us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787707343.888347:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 7 00000100:00100000:3.0:1787707344.044766:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707344.045153:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707690752 00000100:00100000:2.0:1787707344.045164:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707690752 00000100:00100000:2.0:1787707344.045233:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 42 00000100:00100000:2.0:1787707344.045243:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+15:10337:x1874546707690752:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:2.0:1787707344.045268:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707344.045291:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0c6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9ce3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.045427:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0c71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.045441:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.045456:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707344.045516:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787707344.045520:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787707344.045543:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.045570:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0c6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ce3 expref: 17 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.045605:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0c71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ce3 expref: 16 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.045613:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:2.0:1787707344.045616:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787707344.045619:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871a800, rc 0) 00000100:00100000:2.0:1787707344.045689:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+16:10337:x1874546707690752:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 446us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707344.045696:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 42 00000100:00100000:3.0:1787707344.063261:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707344.063361:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707691008 00000100:00100000:2.0:1787707344.063406:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707691008 00000100:00100000:2.0:1787707344.063468:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 43 00000100:00100000:2.0:1787707344.063479:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+16:10337:x1874546707691008:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:2.0:1787707344.063501:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707344.063523:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0c78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9cea expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.063630:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0c7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.063644:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0c7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.063654:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0c7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707344.063664:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787707344.063800:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0c78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cea expref: 19 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.063818:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0c7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cea expref: 18 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.063826:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa06897500) 00010000:00010000:2.0:1787707344.063828:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787707344.063831:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871ae00, rc 0) 00000100:00100000:2.0:1787707344.064496:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+18:10337:x1874546707691008:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 417us (642us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787707344.064506:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 43 00000100:00100000:3.0:1787707344.075042:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707344.075086:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707344.075226:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707691392 00000100:00100000:1.0:1787707344.075237:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707691392 00000100:00100000:1.0:1787707344.075300:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 2 00000100:00100000:1.0:1787707344.075311:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+18:2359:x1874546707691392:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787707344.075327:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707344.075353:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0c7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cea expref: 18 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.075444:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa06897500) 00010000:00010000:1.0:1787707344.075448:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707344.075511:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+17:2359:x1874546707691392:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 202us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707344.075519:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 2 00000100:00100000:2.0:1787707344.075980:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707691264 00000100:00100000:2.0:1787707344.075986:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707691264 00000100:00100000:2.0:1787707344.076037:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 44 00000100:00100000:2.0:1787707344.076046:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+17:10337:x1874546707691264:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:2.0:1787707344.076066:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707344.076081:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0c8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9cf1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.076173:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec0c94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.076187:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec0c94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.076197:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec0c94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707344.076220:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787707344.076341:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0c8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cf1 expref: 20 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.076357:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec0c94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cf1 expref: 19 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.076365:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa06897500) 00010000:00010000:2.0:1787707344.076418:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787707344.076421:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871aa00, rc 0) 00000100:00100000:2.0:1787707344.076458:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+19:10337:x1874546707691264:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 413us (1445us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787707344.076465:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 44 00000100:00100000:3.0:1787707344.081854:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707344.091095:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707691520 00000100:00100000:0.0:1787707344.091109:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707691520 00000100:00100000:0.0:1787707344.091252:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 23 00000100:00100000:0.0:1787707344.091264:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2360:x1874546707691520:12345-192.168.204.46@tcp:1:lfs.0 00010000:00010000:0.0:1787707344.091310:0:8265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8d6e8a/0xc5f18d5f94ec0ca2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.091331:0:8265:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007f83de57/0xc5f18d5f94ec0c55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cd5 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.091341:0:8265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787707344.091345:0:8265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787707344.091351:0:8265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8d6e8a/0xc5f18d5f94ec0ca2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.091693:0:8265:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007f83de57/0xc5f18d5f94ec0c55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cd5 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.091710:0:8265:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007f83de57/0xc5f18d5f94ec0c55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cd5 expref: 7 pid: 6689 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707344.091747:0:8265:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f050e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8265:1874546729749632:192.168.204.46@tcp:104: 00000100:00100000:0.0:1787707344.091912:0:8265:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2a583e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787707344.119914:0:8265:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f050e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8265:1874546729749632:192.168.204.46@tcp:104: 00010000:00010000:0.0:1787707344.119950:0:8265:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d8d6e8a/0xc5f18d5f94ec0ca2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.121597:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707344.133707:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707344.133890:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707691648 00000100:00100000:1.0:1787707344.133917:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707691648 00002000:00100000:1.0:1787707344.133963:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8cfa3acca680 x1874546707691648/t0(0) o4->9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp:235/0 lens 504/0 e 0 to 0 dl 1787707355 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787707344.133975:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa3acca680 with x1874546707691648 ext(0->12) 00010000:00010000:1.0:1787707344.133983:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007f83de57/0xc5f18d5f94ec0c55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cd5 expref: 8 pid: 6689 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.134002:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007f83de57/0xc5f18d5f94ec0c55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cd5 expref: 8 pid: 6689 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787707344.134011:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cfa3acca680 00000100:00100000:1.0:1787707344.134052:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 0 00000100:00100000:1.0:1787707344.134062:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2361:x1874546707691648:12345-192.168.204.46@tcp:4:lfs.0 00000100:00100000:3.0:1787707344.197110:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729749888:0@lo:400:kworker.0 00000100:00100000:3.0:1787707344.197232:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707344.197292:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729750400:0@lo:400:kworker.0 00000100:00100000:3.0:1787707344.197317:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707344.197361:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787707344.197367:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729750016:0@lo:400:kworker.0 00000100:00100000:3.0:1787707344.197691:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707344.197723:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729750400 00000100:00100000:3.0:1787707344.197731:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729750400 00000100:00100000:3.0:1787707344.197786:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787707344.197799:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729750400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707344.197853:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729750400:12345-0@lo:400:kworker.0 Request processed in 58us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707344.197860:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787707344.197961:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729750144:0@lo:400:kworker.0 00000100:00100000:1.0:1787707344.197994:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707344.198031:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787707344.198037:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729749760:0@lo:400:kworker.0 00000100:00100000:1.0:1787707344.198083:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707344.198105:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874546729750272:0@lo:400:kworker.0 00000100:00100000:1.0:1787707344.198128:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707344.198153:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729749760 00000100:00100000:1.0:1787707344.198157:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729749760 00000100:00100000:1.0:1787707344.198186:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787707344.198192:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3316:x1874546729749760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707344.198225:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3316:x1874546729749760:12345-0@lo:400:kworker.0 Request processed in 34us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707344.198231:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787707344.198268:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729749760:0@lo:400:kworker.0 00000100:00100000:1.0:1787707344.198294:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729750144 00000100:00100000:1.0:1787707344.198298:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729750144 00000100:00100000:1.0:1787707344.198323:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787707344.198329:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729750144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707344.198365:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729750144:12345-0@lo:400:kworker.0 Request processed in 35us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707344.198393:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787707344.198420:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729750144:0@lo:400:kworker.0 00000100:00100000:1.0:1787707344.198461:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729749888 00000100:00100000:1.0:1787707344.198465:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729749888 00000100:00100000:1.0:1787707344.198501:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729750016 00000100:00100000:1.0:1787707344.198504:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729750016 00000100:00100000:1.0:1787707344.198519:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729750272 00000100:00100000:1.0:1787707344.198522:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729750272 00000100:00100000:1.0:1787707344.198536:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787707344.198541:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729749888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707344.198583:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729749888:12345-0@lo:400:kworker.0 Request processed in 41us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707344.198590:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787707344.198603:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787707344.198609:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729750016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707344.198637:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729750016:12345-0@lo:400:kworker.0 Request processed in 29us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707344.198642:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787707344.198653:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787707344.198659:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874546729750272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707344.198689:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874546729750272:12345-0@lo:400:kworker.0 Request processed in 30us (559us total) trans 0 rc 0/0 00000100:00080000:2.0:1787707344.199293:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787707344.199300:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787707344.199302:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787707344.210843:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729750400:0@lo:400:kworker.0 00000100:00100000:3.0:1787707344.214425:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729750016:0@lo:400:kworker.0 00000100:00100000:3.0:1787707344.214461:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729749888:0@lo:400:kworker.0 00000100:00100000:1.0:1787707344.215567:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787707344.215627:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874546729750272:0@lo:400:kworker.0 00000001:00100000:3.0:1787707344.236680:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9ed4058d-c366-401f-b84d-540fc0489f0c 00000100:00100000:2.0:1787707344.237497:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+9:2361:x1874546707691648:12345-192.168.204.46@tcp:4:lfs.0 Request processed in 103429us (103794us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787707344.237515:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 0 00002000:00100000:2.0:1787707344.237528:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8cfa3acca680 x1874546707691648/t4294967299(0) o4->9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp:235/0 lens 504/448 e 0 to 0 dl 1787707355 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787707344.237538:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa3acca680 with x1874546707691648 ext(0->12) 00010000:00010000:2.0:1787707344.237550:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007f83de57/0xc5f18d5f94ec0c55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cd5 expref: 9 pid: 6689 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.237567:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007f83de57/0xc5f18d5f94ec0c55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cd5 expref: 9 pid: 6689 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787707344.237584:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cfa3acca680 00000100:00100000:3.0:1787707344.242841:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707344.243070:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707691776 00000100:00100000:0.0:1787707344.243082:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707691776 00010000:00010000:0.0:1787707344.243122:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007f83de57/0xc5f18d5f94ec0c55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cd5 expref: 9 pid: 6689 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707344.243169:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 36 00000100:00100000:0.0:1787707344.243180:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+9:2360:x1874546707691776:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707344.243195:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787707344.243216:0:5842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787707344.243219:0:5842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787707342 00002000:00010000:0.0:1787707344.243222:0:5842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787707342 00002000:00010000:0.0:1787707344.243224:0:5842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787707342 00010000:00010000:0.0:1787707344.243231:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007f83de57/0xc5f18d5f94ec0c55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cd5 expref: 9 pid: 6689 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.243247:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007f83de57/0xc5f18d5f94ec0c55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cd5 expref: 9 pid: 6689 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.243286:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f83de57/0xc5f18d5f94ec0c55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cd5 expref: 9 pid: 6689 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.243305:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787707344.243310:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787707344.243317:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d8d6e8a/0xc5f18d5f94ec0ca2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.243327:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8d6e8a/0xc5f18d5f94ec0ca2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.243366:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707344.243458:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2360:x1874546707691776:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 279us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707344.243467:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 36 00010000:00010000:1.0:1787707344.244317:0:8265:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d8d6e8a/0xc5f18d5f94ec0ca2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.244331:0:8265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d8d6e8a/0xc5f18d5f94ec0ca2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.244359:0:8265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8d6e8a/0xc5f18d5f94ec0ca2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.244397:0:8265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d8d6e8a/0xc5f18d5f94ec0ca2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.244422:0:8265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d8d6e8a/0xc5f18d5f94ec0ca2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.244430:0:8265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2800 already unused, calling callback (ffffffffc1630230) 00010000:00010000:1.0:1787707344.244434:0:8265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8d6e8a/0xc5f18d5f94ec0ca2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.244444:0:8265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8d6e8a/0xc5f18d5f94ec0ca2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.244460:0:8265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d8d6e8a/0xc5f18d5f94ec0ca2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.244467:0:8265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d8d6e8a/0xc5f18d5f94ec0ca2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707344.244545:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2360:x1874546707691520:12345-192.168.204.46@tcp:1:lfs.0 Request processed in 153281us (162697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707344.244554:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 23 00000100:00100000:3.0:1787707344.249516:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707344.249665:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707692032 00000100:00100000:0.0:1787707344.249676:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707692032 00000100:00100000:0.0:1787707344.249737:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 8 00000100:00100000:0.0:1787707344.249748:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+19:10337:x1874546707692032:12345-192.168.204.46@tcp:35:lfs.0 00000004:00010000:0.0:1787707344.249811:0:5859:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec0c94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cf1 expref: 19 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787707344.250117:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1787707344.250170:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1787707344.252522:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787707344.252608:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0ca9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.252633:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0c39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cc7 expref: 23 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.252642:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0ca9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.252678:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0c39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cc7 expref: 23 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.252695:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0c39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cc7 expref: 23 pid: 5856 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707344.252711:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f050e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874546729750528:192.168.204.46@tcp:104: 00000100:00100000:0.0:1787707344.252802:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3acae300 going to sleep for 11 seconds 00000100:00100000:1.0:1787707344.260259:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f050e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874546729750528:192.168.204.46@tcp:104: 00010000:00010000:1.0:1787707344.260290:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0ca9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707344.261512:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707344.261667:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707692160 00000100:00100000:1.0:1787707344.261676:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707692160 00010000:00010000:1.0:1787707344.261738:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0c39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cc7 expref: 24 pid: 5856 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707344.261780:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 37 00000100:00100000:1.0:1787707344.261792:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+24:2362:x1874546707692160:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787707344.261808:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707344.261815:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0c39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cc7 expref: 24 pid: 5856 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.261829:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0c39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cc7 expref: 24 pid: 5856 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.261850:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0c39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cc7 expref: 24 pid: 5856 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.261866:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa06897500) 00010000:00010000:1.0:1787707344.261871:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0ca9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.261879:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0ca9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.261886:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0ca9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.261912:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707344.261971:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+23:2362:x1874546707692160:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 181us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707344.261978:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 37 00010000:00010000:0.0:1787707344.262444:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0ca9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.262452:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0ca9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787707344.262595:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1787707344.262802:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1787707344.262918:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f050380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874546729750656:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787707344.263007:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707344.263044:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3acae9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787707344.263254:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729750656 00000100:00100000:2.0:1787707344.263261:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729750656 00000100:00100000:2.0:1787707344.263300:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787707344.263309:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5859:x1874546729750656:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787707344.263423:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5859:x1874546729750656:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 115us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707344.263431:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787707344.263481:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f050380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874546729750656:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787707344.264127:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1787707344.264183:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874546729750784:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787707344.264218:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707344.264249:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729750784 00000100:00100000:2.0:1787707344.264253:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729750784 00000100:00100000:2.0:1787707344.264277:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787707344.264283:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5859:x1874546729750784:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787707344.264440:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5859:x1874546729750784:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 157us (221us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787707344.264448:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787707344.264468:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3cbd5780 going to sleep for 11 seconds 00000100:00100000:2.0:1787707344.264487:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874546729750784:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787707344.264523:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1787707344.264554:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0ca9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.264573:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0ca9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.264580:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0ca9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.264585:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707344.264590:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0ca9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.264597:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0ca9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.264612:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa06897500) 00010000:00010000:2.0:1787707344.264615:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787707344.264619:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0ca9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.264626:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0ca9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787707344.264781:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787707344.265164:0:5859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787707344.265174:0:5859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 395311803315ns, next at 396311801240ns, rc = 0 00000001:00080000:2.0:1787707344.265184:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1787707344.265214:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa06897500) 00010000:00010000:2.0:1787707344.265218:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787707344.265225:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec0c94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cf1 expref: 27 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707344.265335:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+26:10337:x1874546707692032:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 15588us (15826us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787707344.265344:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 8 00000020:00080000:2.0:1787707344.265348:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787707344.276137:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707344.276243:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707692288 00000100:00100000:2.0:1787707344.276253:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707692288 00000100:00100000:2.0:1787707344.276310:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 45 00000100:00100000:2.0:1787707344.276321:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+26:10337:x1874546707692288:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:2.0:1787707344.276344:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707344.276398:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec0cb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9cf8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.276457:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec0cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cf8 expref: 27 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.276783:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec0cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cf8 expref: 27 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.276809:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:2.0:1787707344.276813:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787707344.276816:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871aa00, rc 0) 00000100:00100000:2.0:1787707344.276885:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+27:10337:x1874546707692288:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 565us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707344.276892:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 45 00000100:00100000:2.0:1787707344.282740:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707344.282893:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707692544 00000100:00100000:1.0:1787707344.282910:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707692544 00000100:00100000:1.0:1787707344.282971:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 9 00000100:00100000:1.0:1787707344.282983:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa189fd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+27:10337:x1874546707692544:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:1.0:1787707344.283236:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa189fd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+28:10337:x1874546707692544:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 255us (506us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787707344.283244:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 9 00000100:00100000:3.0:1787707344.446239:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707344.446344:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707692800 00000100:00100000:0.0:1787707344.446354:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707692800 00000100:00100000:0.0:1787707344.446451:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 46 00000100:00100000:0.0:1787707344.446488:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+28:10347:x1874546707692800:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:0.0:1787707344.446512:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707344.446535:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0cb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9cff expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707344.446651:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787707344.447049:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0cb7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cff expref: 30 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.447065:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa06897700) 00010000:00010000:0.0:1787707344.447067:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787707344.447072:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0cb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cff expref: 30 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.447087:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3a00, rc 0) 00000100:00100000:0.0:1787707344.447205:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+29:10347:x1874546707692800:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 720us (977us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1787707344.447213:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 46 00000100:00100000:3.0:1787707344.457104:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707344.461050:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707692928 00000100:00100000:0.0:1787707344.461065:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707692928 00000100:00100000:0.0:1787707344.461150:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 47 00000100:00100000:0.0:1787707344.462109:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+29:10347:x1874546707692928:12345-192.168.204.46@tcp:34:lfs.0 00010000:00010000:0.0:1787707344.462202:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0cc5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462218:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462263:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462279:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0ccc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462287:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462294:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462429:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0cd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462438:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462445:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787707344.462486:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462497:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462503:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0cc5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462509:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0cc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462526:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3a00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707344.462530:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0cc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462538:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0cc5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462549:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:0.0:1787707344.462552:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707344.462557:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0cc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462563:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0cc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462575:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462580:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0ccc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462586:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0ccc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462591:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707344.462593:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0ccc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462599:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0ccc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462988:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cfa19f4e900) 00010000:00010000:0.0:1787707344.462990:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707344.462993:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0ccc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.462998:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0ccc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.463024:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.463031:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0cd3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.463037:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.463041:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707344.463044:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.463049:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0cd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.463056:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:0.0:1787707344.463058:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707344.463061:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0cd3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.463067:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0cd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707344.463172:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+29:10347:x1874546707692928:12345-192.168.204.46@tcp:34:lfs.0 Request processed in 1073us (6074us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707344.463181:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 47 00000100:00100000:2.0:1787707344.466200:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707344.466567:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707693184 00000100:00100000:1.0:1787707344.466576:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707693184 00000100:00100000:1.0:1787707344.466631:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 10 00000100:00100000:1.0:1787707344.466641:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+29:10347:x1874546707693184:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:1.0:1787707344.466901:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+30:10347:x1874546707693184:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 261us (710us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787707344.466908:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 10 00000100:00100000:3.0:1787707344.542704:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707344.544100:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707693440 00000100:00100000:1.0:1787707344.544114:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707693440 00000100:00100000:1.0:1787707344.544191:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 48 00000100:00100000:1.0:1787707344.544203:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+30:10350:x1874546707693440:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:1.0:1787707344.544231:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707344.544254:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0cda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d06 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544339:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0ce1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544353:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544433:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544452:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0ce8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544459:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544465:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544591:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0cef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544600:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544607:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707344.544615:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787707344.544709:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544716:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0ce1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544723:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544729:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707344.544741:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544748:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0ce1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544760:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:1.0:1787707344.544763:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707344.544768:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0ce1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544774:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0ce1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544790:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544796:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0ce8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544802:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544807:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d5a00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707344.544809:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544815:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0ce8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544822:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cfa06897b00) 00010000:00010000:1.0:1787707344.544824:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707344.544833:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0ce8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544839:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0ce8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544883:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0cda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d06 expref: 33 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544898:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d06 expref: 32 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.544904:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:1.0:1787707344.544906:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787707344.544908:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d5e00, rc 0) 00000100:00100000:1.0:1787707344.544972:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+32:10350:x1874546707693440:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 770us (2278us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1787707344.544980:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 48 00000100:00100000:3.0:1787707344.549844:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707344.550048:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707693568 00000100:00100000:2.0:1787707344.550058:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707693568 00000100:00100000:2.0:1787707344.550123:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 49 00000100:00100000:2.0:1787707344.550133:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+32:10350:x1874546707693568:12345-192.168.204.46@tcp:54:lfs.0 00010000:00010000:2.0:1787707344.550200:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0cfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.550218:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.550230:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.550254:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.550261:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0cfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.550268:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0cfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.550274:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707344.550279:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0cfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.550286:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0cfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.550298:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:2.0:1787707344.550301:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787707344.550320:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0cfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707344.550326:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0cfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707344.550569:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+32:10350:x1874546707693568:12345-192.168.204.46@tcp:54:lfs.0 Request processed in 437us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707344.550578:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 49 00000100:00100000:2.0:1787707344.560974:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707344.561061:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707693824 00000100:00100000:1.0:1787707344.561071:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707693824 00000100:00100000:1.0:1787707344.561131:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 11 00000100:00100000:1.0:1787707344.561143:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+32:10350:x1874546707693824:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:1.0:1787707344.561410:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+33:10350:x1874546707693824:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 269us (445us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787707344.561418:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 11 00000100:00100000:3.0:1787707344.698763:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729750912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787707344.698839:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707344.699141:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729750912 00000100:00100000:0.0:1787707344.699151:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729750912 00000100:00100000:0.0:1787707344.699210:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787707344.699220:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874546729750912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787707344.699244:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707344.699289:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874546729750912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707344.699295:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787707344.701566:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729750912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787707344.962367:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707344.962482:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707694080 00000100:00100000:1.0:1787707344.962492:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707694080 00000100:00100000:1.0:1787707344.962547:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 50 00000100:00100000:1.0:1787707344.962558:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+33:10381:x1874546707694080:12345-192.168.204.46@tcp:101:cat.0 00010000:00010000:1.0:1787707344.962592:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707344.962614:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0d04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d0d expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.962712:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0d0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.962726:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.962739:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707344.962750:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787707344.962911:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0d04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d0d expref: 36 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.962931:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0d0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d0d expref: 35 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707344.962939:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:1.0:1787707344.962942:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787707344.962946:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d5a00, rc 0) 00000100:00100000:1.0:1787707344.963024:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+35:10381:x1874546707694080:12345-192.168.204.46@tcp:101:cat.0 Request processed in 467us (666us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1787707344.963031:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 50 00000100:00100000:3.0:1787707344.973956:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707344.974963:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707344.975416:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707694464 00000100:00100000:0.0:1787707344.975426:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707694464 00000100:00100000:0.0:1787707344.975498:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 3 00000100:00100000:0.0:1787707344.975508:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa113cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+35:2360:x1874546707694464:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707344.975524:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707344.975547:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0d0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d0d expref: 35 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707344.975567:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:0.0:1787707344.975572:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707344.975781:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa113cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+34:2360:x1874546707694464:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 272us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707344.975790:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 3 00000100:00100000:1.0:1787707344.976194:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707694336 00000100:00100000:1.0:1787707344.976201:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707694336 00000100:00100000:1.0:1787707344.976239:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 12 00000100:00100000:1.0:1787707344.976261:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+34:10381:x1874546707694336:12345-192.168.204.46@tcp:35:cat.0 00000100:00100000:1.0:1787707344.976550:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+35:10381:x1874546707694336:12345-192.168.204.46@tcp:35:cat.0 Request processed in 291us (2604us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787707344.976558:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 12 00000100:00100000:2.0:1787707345.105648:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707345.105817:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707694720 00000100:00100000:0.0:1787707345.105842:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707694720 00000100:00100000:0.0:1787707345.105932:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 51 00000100:00100000:0.0:1787707345.105943:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+35:10387:x1874546707694720:12345-192.168.204.46@tcp:101:dd.0 00010000:00010000:0.0:1787707345.105972:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707345.105976:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787707345.106016:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0c71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ce3 expref: 35 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707345.106035:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:0.0:1787707345.106040:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787707345.106055:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d19 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d14 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707345.106159:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0d20 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707345.106173:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0cef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d06 expref: 35 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707345.106181:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0d20 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787707345.106226:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787707345.106232:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d06 expref: 35 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707345.106246:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0cef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d06 expref: 35 pid: 5857 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707345.106263:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f053480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874546729751040:192.168.204.46@tcp:104: 00000100:00100000:0.0:1787707345.106427:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3acae6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787707345.109653:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707345.109747:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707694848 00000100:00100000:1.0:1787707345.109759:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707694848 00010000:00010000:1.0:1787707345.109799:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0cef lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d06 expref: 36 pid: 5857 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707345.109842:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 38 00000100:00100000:1.0:1787707345.109851:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+36:2362:x1874546707694848:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787707345.109865:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707345.109871:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0cef lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d06 expref: 36 pid: 5857 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.109885:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0cef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d06 expref: 36 pid: 5857 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.109916:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:1.0:1787707345.109922:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0d20 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.109931:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0d20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.109939:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0d20 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.109973:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707345.110043:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+36:2362:x1874546707694848:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 191us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707345.110051:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 38 00010000:00010000:0.0:1787707345.110476:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0cef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d06 expref: 35 pid: 5857 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707345.110494:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f053480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874546729751040:192.168.204.46@tcp:104: 00010000:00010000:0.0:1787707345.110514:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0d20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707345.110524:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0d20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707345.110529:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0d20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707345.110547:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787707345.110710:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d19 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d14 expref: 36 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707345.110725:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0d20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d14 expref: 35 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707345.110732:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:0.0:1787707345.110735:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787707345.110737:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2600, rc 0) 00000100:00100000:0.0:1787707345.110780:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+35:10387:x1874546707694720:12345-192.168.204.46@tcp:101:dd.0 Request processed in 4839us (5144us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787707345.110788:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 51 00000100:00100000:3.0:1787707345.114190:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707345.119499:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707695104 00000100:00100000:0.0:1787707345.119529:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707695104 00000100:00100000:0.0:1787707345.119596:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 52 00000100:00100000:0.0:1787707345.119607:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+35:10387:x1874546707695104:12345-192.168.204.46@tcp:36:dd.0 00010000:00010000:0.0:1787707345.119874:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707345.119914:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707345.119928:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787707345.119982:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1787707345.120018:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037e8469b reply state 00000000d54b15ca transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707345.120028:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787707345.120124:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+38:10387:x1874546707695104:12345-192.168.204.46@tcp:36:dd.0 Request processed in 518us (5948us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1787707345.120132:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 52 00000020:00080000:0.0:1787707345.120137:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787707345.126073:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707345.126092:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707345.126099:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707345.126105:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3a00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707345.126110:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707345.126131:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d2e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707345.126148:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:0.0:1787707345.126151:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707345.126155:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d2e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707345.126161:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.144651:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707345.704516:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707345.704701:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707695232 00000100:00100000:1.0:1787707345.704712:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707695232 00000100:00100000:1.0:1787707345.704781:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 53 00000100:00100000:1.0:1787707345.704793:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+37:10401:x1874546707695232:12345-192.168.204.46@tcp:101:stat.0 00010000:00010000:1.0:1787707345.704821:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707345.704843:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0d35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d1b expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.704927:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0d3c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.704942:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0d3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.704953:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0d3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.704969:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0d43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.704976:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0d43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.704982:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0d43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.705129:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0d4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.705140:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0d20 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d14 expref: 38 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.705149:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0d4a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.705183:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0d20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d14 expref: 38 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.705198:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0d20 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d14 expref: 38 pid: 5858 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707345.705213:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2a590000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874546729751168:192.168.204.46@tcp:104: 00000100:00100000:1.0:1787707345.705310:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05edbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787707345.712849:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2a590000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874546729751168:192.168.204.46@tcp:104: 00010000:00010000:1.0:1787707345.712894:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0d4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707345.713515:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707345.714031:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707695488 00000100:00100000:2.0:1787707345.714041:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707695488 00000100:00100000:2.0:1787707345.714112:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 13 00000100:00100000:2.0:1787707345.714124:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+39:5600:x1874546707695488:12345-192.168.204.46@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787707345.716211:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+40:5600:x1874546707695488:12345-192.168.204.46@tcp:35:ldlm_bl.0 Request processed in 2079us (2688us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1787707345.716223:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 13 00000100:00100000:2.0:1787707345.720549:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707345.720963:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707695616 00000100:00100000:3.0:1787707345.720973:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707695616 00010000:00010000:3.0:1787707345.721027:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0d20 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d14 expref: 40 pid: 5858 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707345.721124:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 39 00000100:00100000:3.0:1787707345.721136:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+40:2361:x1874546707695616:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787707345.721153:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707345.721161:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0d20 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d14 expref: 40 pid: 5858 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707345.721175:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0d20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d14 expref: 40 pid: 5858 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707345.721215:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0d20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d14 expref: 40 pid: 5858 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707345.721229:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:3.0:1787707345.721234:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0d4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707345.721243:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707345.721250:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0d4a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707345.721282:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707345.721459:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+39:2361:x1874546707695616:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 325us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707345.721468:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 39 00010000:00010000:1.0:1787707345.721529:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.721538:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707345.721593:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787707345.721603:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787707345.721644:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.721657:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.721666:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0d3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.721672:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0d3c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.721678:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0d3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.721696:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707345.721700:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0d3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.721707:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0d3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.721717:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:1.0:1787707345.721720:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707345.721724:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0d3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.721730:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0d3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.721742:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0d43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.721758:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0d43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.721764:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0d43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.722638:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d5e00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707345.722644:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0d43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.722654:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0d43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.722667:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cfa06897b00) 00010000:00010000:1.0:1787707345.722670:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707345.722674:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0d43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.722681:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0d43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.722740:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0d35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d1b expref: 39 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.722755:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0d4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d1b expref: 38 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707345.722762:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:1.0:1787707345.722765:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787707345.722789:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d5a00, rc 0) 00000100:00100000:1.0:1787707345.722860:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+38:10401:x1874546707695232:12345-192.168.204.46@tcp:101:stat.0 Request processed in 18069us (18353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707345.722879:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 53 00000100:00100000:2.0:1787707345.802832:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707345.802906:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707345.802941:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707345.803083:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707696000 00000100:00100000:3.0:1787707345.803094:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707696000 00000100:00100000:3.0:1787707345.803170:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 156 00000100:00100000:3.0:1787707345.803181:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2359:x1874546707696000:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707345.803258:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2359:x1874546707696000:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 80us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707345.803265:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 156 00000100:00100000:0.0:1787707345.803711:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707695744 00000100:00100000:0.0:1787707345.803716:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707695744 00000100:00100000:0.0:1787707345.803758:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 294 00000100:00100000:0.0:1787707345.803775:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+13:2359:x1874546707695744:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707345.803820:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+13:2359:x1874546707695744:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 55us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707345.803827:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 294 00000100:00080000:2.0:1787707345.804347:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787707345.804431:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707695872 00000100:00100000:1.0:1787707345.804437:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707695872 00000100:00100000:1.0:1787707345.804497:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 84 00000100:00100000:1.0:1787707345.804505:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2359:x1874546707695872:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707345.804550:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2359:x1874546707695872:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 46us (1728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707345.804556:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 84 00000100:00080000:2.0:1787707345.804724:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787707345.838613:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707345.838808:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707696256 00000100:00100000:0.0:1787707345.838823:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707696256 00000100:00100000:0.0:1787707345.838996:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 54 00000100:00100000:0.0:1787707345.839009:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+38:10407:x1874546707696256:12345-192.168.204.46@tcp:36:truncate.0 00010000:00010000:0.0:1787707345.839175:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707345.839207:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0d4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d1b expref: 38 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707345.839230:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:0.0:1787707345.839242:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787707345.839760:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707345.839775:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707345.839786:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787707345.839843:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1787707345.839869:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042042a7a reply state 00000000b1f98224 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707345.839879:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787707345.840051:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+40:10407:x1874546707696256:12345-192.168.204.46@tcp:36:truncate.0 Request processed in 1034us (1442us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787707345.840060:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 54 00000020:00080000:0.0:1787707345.840065:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787707345.844625:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707345.844674:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707345.844684:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707345.844691:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707345.844697:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707345.844705:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707345.844729:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:3.0:1787707345.844732:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707345.844739:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707345.844746:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707346.153598:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707346.153716:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707696384 00000100:00100000:0.0:1787707346.153728:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707696384 00000100:00100000:0.0:1787707346.153791:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 55 00000100:00100000:0.0:1787707346.153803:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+39:10421:x1874546707696384:12345-192.168.204.46@tcp:101:stat.0 00010000:00010000:0.0:1787707346.153828:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707346.153851:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0d58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d22 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.153918:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0d5f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.153933:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0d5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.153962:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0d5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.153991:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154000:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154007:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154103:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154113:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154120:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707346.154169:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787707346.154174:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787707346.154197:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154209:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154218:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0d5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154236:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0d5f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154243:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0d5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154250:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707346.154254:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0d5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154262:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0d5f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154275:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:0.0:1787707346.154278:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707346.154283:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0d5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154290:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0d5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154304:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154310:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154317:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154322:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707346.154332:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154339:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154347:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cfa19f4e900) 00010000:00010000:0.0:1787707346.154349:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707346.154352:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154358:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154445:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0d58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d22 expref: 41 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154459:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d22 expref: 40 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.154466:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:0.0:1787707346.154469:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787707346.154471:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3a00, rc 0) 00000100:00100000:0.0:1787707346.154539:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+40:10421:x1874546707696384:12345-192.168.204.46@tcp:101:stat.0 Request processed in 738us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707346.154546:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 55 00010000:00010000:0.0:1787707346.168608:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707346.311099:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707346.311364:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707696640 00000100:00100000:1.0:1787707346.311409:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707696640 00000100:00100000:1.0:1787707346.311462:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 56 00000100:00100000:1.0:1787707346.311474:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+40:10431:x1874546707696640:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:1.0:1787707346.311494:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707346.311517:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0d74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d29 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707346.311747:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787707346.313409:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0d74 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d29 expref: 42 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.313452:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa06897700) 00010000:00010000:0.0:1787707346.313455:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787707346.313461:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0d74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d29 expref: 42 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.313479:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d4000, rc 0) 00000100:00100000:0.0:1787707346.313668:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+41:10431:x1874546707696640:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 2193us (2577us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1787707346.313687:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 56 00000100:00100000:3.0:1787707346.321224:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707346.334416:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707696896 00000100:00100000:2.0:1787707346.334431:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707696896 00000100:00100000:2.0:1787707346.334525:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 14 00000100:00100000:2.0:1787707346.334536:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+41:10431:x1874546707696896:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:2.0:1787707346.334793:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+42:10431:x1874546707696896:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 258us (13578us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787707346.334801:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 14 00000100:00100000:1.0:1787707346.483059:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707346.483161:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707697152 00000100:00100000:0.0:1787707346.483172:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707697152 00000100:00100000:0.0:1787707346.483233:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 57 00000100:00100000:0.0:1787707346.483244:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+42:10436:x1874546707697152:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:0.0:1787707346.483269:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707346.483291:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0d82 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d30 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.483447:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d89 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.483462:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d22 expref: 43 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.483471:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d89 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.483502:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d22 expref: 43 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.483529:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d22 expref: 43 pid: 5856 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707346.483543:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f053800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874546729751296:192.168.204.46@tcp:104: 00000100:00100000:0.0:1787707346.483649:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3acae900 going to sleep for 11 seconds 00000100:00100000:0.0:1787707346.492994:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f053800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874546729751296:192.168.204.46@tcp:104: 00010000:00010000:0.0:1787707346.493029:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d89 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707346.510673:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707346.510791:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707697280 00000100:00100000:2.0:1787707346.510801:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707697280 00010000:00010000:2.0:1787707346.510843:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d22 expref: 44 pid: 5856 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707346.510894:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 40 00000100:00100000:2.0:1787707346.510918:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a593b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+44:2361:x1874546707697280:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787707346.510936:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707346.510942:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d22 expref: 44 pid: 5856 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.510956:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d22 expref: 44 pid: 5856 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.510994:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0d6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d22 expref: 44 pid: 5856 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.511011:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:2.0:1787707346.511016:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d89 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.511025:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.511048:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d89 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.511085:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707346.511152:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a593b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+43:2361:x1874546707697280:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 235us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707346.511160:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 40 00010000:00010000:0.0:1787707346.513028:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.513044:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707346.513068:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787707346.513257:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0d82 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d30 expref: 44 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.513279:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d30 expref: 43 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.513287:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:0.0:1787707346.513289:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787707346.513292:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2200, rc 0) 00000100:00100000:0.0:1787707346.513367:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+43:10436:x1874546707697152:12345-192.168.204.46@tcp:101:bash.0 Request processed in 30124us (30318us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1787707346.513418:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 57 00000100:00100000:1.0:1787707346.525041:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707346.525211:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707697536 00000100:00100000:0.0:1787707346.525223:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707697536 00000100:00100000:0.0:1787707346.525287:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 58 00000100:00100000:0.0:1787707346.525298:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+43:10436:x1874546707697536:12345-192.168.204.46@tcp:36:bash.0 00010000:00010000:0.0:1787707346.526282:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0d97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.526302:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0d97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.526314:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0d97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787707346.526415:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1787707346.526445:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9821fe0 reply state 000000008a621655 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0d97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707346.526454:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787707346.526545:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+46:10436:x1874546707697536:12345-192.168.204.46@tcp:36:bash.0 Request processed in 1246us (1513us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787707346.526552:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 58 00000020:00080000:0.0:1787707346.526558:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787707346.537084:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707346.537277:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707697664 00000100:00100000:2.0:1787707346.537289:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707697664 00000100:00100000:2.0:1787707346.537360:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 59 00000100:00100000:2.0:1787707346.537411:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+46:10436:x1874546707697664:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:2.0:1787707346.537436:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707346.537459:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0d9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d37 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.537580:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0da5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.537596:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d89 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d30 expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.537603:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0d97 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.537610:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0da5 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.537628:0:5857:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0d97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.537662:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d30 expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.537676:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d89 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d30 expref: 47 pid: 5856 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707346.537690:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa418ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874546729751424:192.168.204.46@tcp:104: 00000100:00100000:2.0:1787707346.537764:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3cbd5000 going to sleep for 11 seconds 00010000:00010000:0.0:1787707346.539074:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0d97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.539089:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0d97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.539097:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0d97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.539129:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707346.539134:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0d97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.539142:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0d97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.539159:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:0.0:1787707346.539162:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707346.539166:0:3301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0da5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.539175:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0d97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.539181:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0d97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707346.545754:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa418ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874546729751424:192.168.204.46@tcp:104: 00010000:00010000:2.0:1787707346.545787:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0da5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707346.550512:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707346.550765:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707697792 00000100:00100000:0.0:1787707346.550775:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707697792 00010000:00010000:0.0:1787707346.550816:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d89 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d30 expref: 47 pid: 5856 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707346.550861:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 41 00000100:00100000:0.0:1787707346.550871:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+47:2362:x1874546707697792:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707346.550888:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707346.550907:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d89 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d30 expref: 47 pid: 5856 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.550942:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d30 expref: 47 pid: 5856 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.550965:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0d89 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d30 expref: 47 pid: 5856 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.550993:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:0.0:1787707346.550998:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0da5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.551007:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.551014:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0da5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.551049:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707346.551108:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+46:2362:x1874546707697792:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 238us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707346.551115:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 41 00010000:00010000:2.0:1787707346.551231:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.551240:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707346.551284:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787707346.551288:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787707346.551309:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.551339:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0d9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d37 expref: 46 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.551354:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0da5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d37 expref: 45 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.551425:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:2.0:1787707346.551428:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787707346.551431:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871a600, rc 0) 00000100:00100000:2.0:1787707346.551456:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+45:10436:x1874546707697664:12345-192.168.204.46@tcp:101:bash.0 Request processed in 14088us (14384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707346.551463:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 59 00000100:00100000:1.0:1787707346.563604:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707346.563764:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707698048 00000100:00100000:2.0:1787707346.563775:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707698048 00000100:00100000:2.0:1787707346.563841:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 15 00000100:00100000:2.0:1787707346.563860:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa189fd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+45:10436:x1874546707698048:12345-192.168.204.46@tcp:35:bash.0 00000100:00100000:2.0:1787707346.564334:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa189fd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+46:10436:x1874546707698048:12345-192.168.204.46@tcp:35:bash.0 Request processed in 482us (738us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787707346.564343:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 15 00000100:00100000:1.0:1787707346.697406:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707346.697514:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707698304 00000100:00100000:2.0:1787707346.697524:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707698304 00000100:00100000:2.0:1787707346.697600:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 60 00000100:00100000:2.0:1787707346.697612:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+46:10447:x1874546707698304:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:2.0:1787707346.697636:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707346.697658:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec0dac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d3e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707346.697773:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787707346.698178:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec0dac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d3e expref: 48 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.698211:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa06897700) 00010000:00010000:2.0:1787707346.698215:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787707346.698220:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec0dac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d3e expref: 48 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.698234:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871bc00, rc 0) 00000100:00100000:2.0:1787707346.698303:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+47:10447:x1874546707698304:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 694us (935us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787707346.698311:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 60 00000100:00100000:2.0:1787707346.702844:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707346.703036:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707698432 00000100:00100000:3.0:1787707346.703046:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707698432 00000100:00100000:3.0:1787707346.703103:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 61 00000100:00100000:3.0:1787707346.703112:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+47:10447:x1874546707698432:12345-192.168.204.46@tcp:34:lfs.0 00010000:00010000:3.0:1787707346.703204:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0dba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703220:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0dba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703232:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0dba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703247:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec0dc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703255:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec0dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703262:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec0dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703361:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0dc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703398:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703407:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787707346.703452:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703463:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0dba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703478:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0dba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703486:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0dba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703492:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707346.703496:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0dba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703503:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0dba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703515:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:3.0:1787707346.703519:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707346.703523:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0dba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703530:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0dba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703546:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec0dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703552:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec0dc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703557:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec0dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703685:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707346.703695:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec0dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703701:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec0dc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703710:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cfa143e4300) 00010000:00010000:3.0:1787707346.703713:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707346.703716:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec0dc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703721:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec0dc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703737:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703743:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0dc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703749:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703755:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fca00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707346.703757:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703762:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0dc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703769:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:3.0:1787707346.703771:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707346.703781:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0dc8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707346.703786:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0dc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707346.706103:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+47:10447:x1874546707698432:12345-192.168.204.46@tcp:34:lfs.0 Request processed in 2979us (3259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707346.706126:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 61 00000100:00100000:1.0:1787707346.720924:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707346.721031:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707698688 00000100:00100000:2.0:1787707346.721045:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707698688 00000100:00100000:2.0:1787707346.721121:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 16 00000100:00100000:2.0:1787707346.721133:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+47:10447:x1874546707698688:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:2.0:1787707346.721468:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+48:10447:x1874546707698688:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 326us (555us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787707346.721478:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 16 00000040:00080000:0.0:1787707346.745273:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787707346.858629:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707346.858825:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707698944 00000100:00100000:0.0:1787707346.858840:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707698944 00000100:00100000:0.0:1787707346.858921:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 62 00000100:00100000:0.0:1787707346.858934:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+48:10450:x1874546707698944:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:0.0:1787707346.858964:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707346.859003:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0dcf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d45 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859103:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0dd6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859120:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0dd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859133:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0dd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859149:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0ddd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859157:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859163:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859326:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0de4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859336:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859343:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707346.859355:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787707346.859551:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0dd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859560:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0dd6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859578:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0dd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859584:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707346.859588:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0dd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859597:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0dd6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859613:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:0.0:1787707346.859616:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707346.859621:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0dd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859628:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0dd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859645:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859652:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0ddd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859658:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0ddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859663:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707346.859665:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0ddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859680:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0ddd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859690:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cfa19f4e900) 00010000:00010000:0.0:1787707346.859692:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707346.859695:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0ddd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859700:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0ddd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859753:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0dcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d45 expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859768:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0de4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d45 expref: 50 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707346.859775:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:0.0:1787707346.859777:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787707346.859780:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2600, rc 0) 00000100:00100000:0.0:1787707346.859865:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+50:10450:x1874546707698944:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 933us (1251us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787707346.859874:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 62 00000100:00100000:3.0:1787707346.868116:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707346.868331:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707699072 00000100:00100000:2.0:1787707346.868341:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707699072 00000100:00100000:2.0:1787707346.868450:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 63 00000100:00100000:2.0:1787707346.868460:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+50:10450:x1874546707699072:12345-192.168.204.46@tcp:54:lfs.0 00010000:00010000:2.0:1787707346.868532:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec0df2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.868549:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec0df2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.868584:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec0df2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.868613:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec0df2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.868619:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec0df2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.868624:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec0df2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.868630:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871bc00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707346.868634:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec0df2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.868641:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec0df2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.868653:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:2.0:1787707346.868655:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787707346.868659:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec0df2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.868664:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec0df2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707346.868741:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+50:10450:x1874546707699072:12345-192.168.204.46@tcp:54:lfs.0 Request processed in 282us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707346.868750:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 63 00000100:00100000:1.0:1787707346.875315:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707346.876669:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707699200 00000100:00100000:2.0:1787707346.876697:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707699200 00000100:00100000:2.0:1787707346.876771:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 4 00000100:00100000:2.0:1787707346.876783:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a593480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+50:2362:x1874546707699200:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787707346.876802:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707346.876829:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0de4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d45 expref: 50 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707346.876858:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:2.0:1787707346.876864:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707346.876919:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a593480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+49:2362:x1874546707699200:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 138us (1622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707346.876927:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 4 00000100:00100000:3.0:1787707346.878442:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707346.879077:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707699456 00000100:00100000:0.0:1787707346.879088:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707699456 00000100:00100000:0.0:1787707346.879160:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 17 00000100:00100000:0.0:1787707346.879171:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+49:10450:x1874546707699456:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:0.0:1787707346.879456:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+50:10450:x1874546707699456:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 286us (1019us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1787707346.879464:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 17 00010000:00010000:1.0:1787707347.192687:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707347.211499:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707347.212111:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707699712 00000100:00100000:0.0:1787707347.212124:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707699712 00000100:00100000:0.0:1787707347.212219:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 64 00000100:00100000:0.0:1787707347.212232:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+50:10468:x1874546707699712:12345-192.168.204.46@tcp:101:cat.0 00010000:00010000:0.0:1787707347.212256:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707347.212280:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0df9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d4c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787707347.212446:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787707347.212608:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0e00 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.212624:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0e00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.212636:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0e00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707347.212648:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787707347.213131:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0df9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d4c expref: 53 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.213157:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0e00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d4c expref: 52 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.213167:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:0.0:1787707347.213185:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787707347.213189:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3000, rc 0) 00000100:00100000:0.0:1787707347.213359:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+52:10468:x1874546707699712:12345-192.168.204.46@tcp:101:cat.0 Request processed in 1129us (1870us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787707347.213367:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 64 00000100:00100000:1.0:1787707347.248681:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707347.248869:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707699840 00000100:00100000:2.0:1787707347.248881:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707699840 00000100:00100000:2.0:1787707347.248950:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 65 00000100:00100000:2.0:1787707347.248971:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+52:10469:x1874546707699840:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:2.0:1787707347.248995:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707347.249015:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec0e0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d53 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.249084:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec0e15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.249098:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec0e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.249109:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec0e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707347.249184:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787707347.249188:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787707347.249211:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec0e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.249238:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec0e0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d53 expref: 54 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.249257:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec0e15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d53 expref: 53 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.249265:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:2.0:1787707347.249268:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787707347.249272:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871b200, rc 0) 00000100:00100000:2.0:1787707347.249351:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+53:10469:x1874546707699840:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 391us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707347.249359:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 65 00000100:00100000:1.0:1787707347.256607:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729751552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787707347.256681:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707347.257046:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729751552 00000100:00100000:3.0:1787707347.257057:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729751552 00000100:00100000:3.0:1787707347.257131:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787707347.257144:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729751552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787707347.257185:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787707347.257314:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787707347.257566:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729751552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 425us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707347.257574:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787707347.263594:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729751552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787707347.290933:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707347.291045:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707700224 00000100:00100000:2.0:1787707347.291055:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707700224 00000100:00100000:2.0:1787707347.291121:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 18 00000100:00100000:2.0:1787707347.291132:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+53:10469:x1874546707700224:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:2.0:1787707347.291507:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+54:10469:x1874546707700224:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 375us (583us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787707347.291514:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 18 00000100:00100000:0.0:1787707347.302715:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707347.302813:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707700352 00000100:00100000:3.0:1787707347.302822:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707700352 00000100:00100000:3.0:1787707347.302899:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 5 00000100:00100000:3.0:1787707347.302911:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f053800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+54:10469:x1874546707700352:12345-192.168.204.46@tcp:103:lfs.0 00010000:00010000:3.0:1787707347.302930:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787707347.302956:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec0da5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d37 expref: 54 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.302992:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec0e00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d4c expref: 53 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.303019:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec0cb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cf8 expref: 52 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.303028:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:3.0:1787707347.303039:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707347.303100:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f053800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+51:10469:x1874546707700352:12345-192.168.204.46@tcp:103:lfs.0 Request processed in 191us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707347.303106:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 5 00000100:00100000:1.0:1787707347.315093:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707347.315175:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707700480 00000100:00100000:3.0:1787707347.315185:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707700480 00000100:00100000:3.0:1787707347.315258:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 66 00000100:00100000:3.0:1787707347.315269:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+51:10469:x1874546707700480:12345-192.168.204.46@tcp:58:lfs.0 00010000:00010000:3.0:1787707347.315445:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec0e1c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.315461:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec0e1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.315472:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec0e1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787707347.315756:0:8469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787707347.316348:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1787707347.316569:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1787707347.316731:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+51:10469:x1874546707700480:12345-192.168.204.46@tcp:58:lfs.0 Request processed in 1459us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707347.316741:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 66 00000100:00100000:1.0:1787707347.370753:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707347.371102:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707700608 00000100:00100000:2.0:1787707347.371127:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707700608 00000100:00100000:2.0:1787707347.371185:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 67 00000100:00100000:2.0:1787707347.371196:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+51:10471:x1874546707700608:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:2.0:1787707347.371216:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707347.371524:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec0e23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d5a expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.371597:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0e2a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.371611:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0e2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.371623:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0e2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.371638:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0e31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.371646:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.371653:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.371755:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0e38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.371765:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.371772:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707347.371816:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787707347.371820:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787707347.375244:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.375275:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.375288:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0e2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.375483:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0e2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.375492:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0e2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.375500:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871a800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707347.375504:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0e2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.375513:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0e2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.375531:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:3.0:1787707347.375534:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707347.375539:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0e2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.375546:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0e2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.375565:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.375572:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0e31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.375594:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0e31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.375599:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871ba00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707347.375602:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0e31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.375609:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0e31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.375618:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cfa12a49d00) 00010000:00010000:3.0:1787707347.375620:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707347.375623:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0e31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.375628:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0e31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.375681:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec0e23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d5a expref: 53 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.375696:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0e38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d5a expref: 52 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.375703:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa143e4300) 00010000:00010000:3.0:1787707347.375705:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787707347.375708:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871b400, rc 0) 00000100:00100000:3.0:1787707347.375860:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+52:10471:x1874546707700608:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 4664us (5116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707347.375879:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 67 00000040:00080000:2.0:1787707347.772171:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787707347.772178:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787707347.772234:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787707347.772242:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787707347.772357:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa418ed880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874546729751680:192.168.204.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787707347.772467:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05ebccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707347.784359:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa418ed880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874546729751680:192.168.204.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787707347.792660:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707347.793542:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707700736 00000100:00100000:0.0:1787707347.793554:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707700736 00000100:00100000:0.0:1787707347.793611:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 1 00000100:00100000:0.0:1787707347.793623:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9ed4058d-c366-401f-b84d-540fc0489f0c+52:10482:x1874546707700736:12345-192.168.204.46@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787707347.793722:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9ed4058d-c366-401f-b84d-540fc0489f0c+52:10482:x1874546707700736:12345-192.168.204.46@tcp:900:lhsmtool_posix.0 Request processed in 101us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707347.793730:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 1 00000100:00100000:1.0:1787707347.814197:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707347.814245:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707700864 00000100:00100000:1.0:1787707347.814255:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707700864 00000100:00100000:1.0:1787707347.814309:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 68 00000100:00100000:1.0:1787707347.814319:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+52:10482:x1874546707700864:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787707347.814351:0:5858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787707347.814496:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+52:10482:x1874546707700864:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 Request processed in 176us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707347.814504:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 68 00000100:00100000:0.0:1787707347.825791:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707347.826546:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707700992 00000100:00100000:0.0:1787707347.826556:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707700992 00000100:00100000:0.0:1787707347.826615:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 69 00000100:00100000:0.0:1787707347.826626:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+52:10482:x1874546707700992:12345-192.168.204.46@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787707347.828873:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0e3f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.828895:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0e3f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.828906:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0e3f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.829260:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0e46 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.829269:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0e46 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.829277:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0e46 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.829477:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0e4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.829487:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.829494:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707347.829540:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787707347.829545:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787707347.829562:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.829573:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0e3f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.829580:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0e3f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.829586:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0e3f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.829602:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707347.829606:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0e3f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.829619:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0e3f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.829632:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfa06897a00) 00010000:00010000:0.0:1787707347.829634:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707347.829639:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0e3f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.829645:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0e3f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.829656:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0e46 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.829662:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0e46 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.829668:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0e46 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.829673:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707347.829675:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0e46 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.833124:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0e46 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.833166:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8cfa19f4e900) 00010000:00010000:0.0:1787707347.833169:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707347.833176:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0e46 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.833183:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0e46 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.833211:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.833217:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0e4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.833224:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0e4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.833229:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707347.833233:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0e4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.833237:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0e4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.833244:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa143e4300) 00010000:00010000:0.0:1787707347.833247:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707347.833250:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0e4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.833255:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0e4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707347.833410:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+52:10482:x1874546707700992:12345-192.168.204.46@tcp:34:lhsmtool_posix.0 Request processed in 6780us (7623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707347.833420:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 69 00000100:00100000:0.0:1787707347.837923:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707347.837970:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707701248 00000100:00100000:0.0:1787707347.837979:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707701248 00000100:00100000:0.0:1787707347.838031:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 70 00000100:00100000:0.0:1787707347.838042:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+52:10482:x1874546707701248:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787707347.838063:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707347.838085:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0e54 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.838185:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0e5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.838199:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.838210:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707347.838221:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787707347.838425:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.838434:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0e5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.838440:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0e5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.838454:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707347.838458:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0e5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.838465:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0e5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.838477:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa143e4300) 00010000:00010000:0.0:1787707347.838479:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787707347.838484:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0e5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.838489:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0e5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.838530:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0e54 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d61 expref: 54 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.838541:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfa06897a00) 00010000:00010000:0.0:1787707347.838543:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787707347.838547:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0e54 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d61 expref: 54 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.838557:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2200, rc 0) 00000100:00100000:0.0:1787707347.838613:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+53:10482:x1874546707701248:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 572us (710us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1787707347.838621:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 70 00000100:00100000:1.0:1787707347.876712:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707347.878357:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707701376 00000100:00100000:3.0:1787707347.878395:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707701376 00000100:00100000:3.0:1787707347.878469:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 71 00000100:00100000:3.0:1787707347.878481:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+53:10482:x1874546707701376:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787707347.878519:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787707347.878629:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+53:10482:x1874546707701376:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 Request processed in 150us (1927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707347.878637:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 71 00000100:00100000:0.0:1787707347.886635:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707347.889202:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707701632 00000100:00100000:3.0:1787707347.889218:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707701632 00000100:00100000:3.0:1787707347.889306:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 72 00000100:00100000:3.0:1787707347.889318:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+53:10482:x1874546707701632:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787707347.889337:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707347.889341:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787707347.889396:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec0e15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d53 expref: 53 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.889419:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:3.0:1787707347.889423:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787707347.889450:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0e69 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d68 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787707347.904092:0:5858:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787707347.904419:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec0e70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.904448:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec0e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.904460:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec0e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.904537:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0e69 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d68 expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.904557:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec0e70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d68 expref: 54 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.904567:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cfa143e4100) 00010000:00010000:3.0:1787707347.904570:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787707347.904573:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fc800, rc 0) 00000100:00100000:3.0:1787707347.904646:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+54:10482:x1874546707701632:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 15330us (18019us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787707347.904655:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 72 00000100:00100000:2.0:1787707347.911292:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707347.911609:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707701888 00000100:00100000:2.0:1787707347.911619:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707701888 00000100:00100000:2.0:1787707347.911676:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 73 00000100:00100000:2.0:1787707347.911688:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+54:10482:x1874546707701888:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787707347.911756:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707347.911784:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec0e70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d68 expref: 54 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.911805:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cfa143e4100) 00010000:00010000:2.0:1787707347.911814:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787707347.911846:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0e7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.911860:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0e7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.911869:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0e7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.911931:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec0e85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x6a0d7965 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.911940:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec0e85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6a0d7965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.911955:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec0e85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6a0d7965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.912204:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0e7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.912212:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0e7e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.912219:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0e7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.912225:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707347.912229:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0e7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.912237:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0e7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.912246:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:2.0:1787707347.912249:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707347.912253:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0e7e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.912259:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0e7e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.912292:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec0e85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6a0d7965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.912298:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec0e85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6a0d7965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.912303:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec0e85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6a0d7965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.912308:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871be00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707347.912311:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec0e85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6a0d7965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.912316:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec0e85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6a0d7965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.912324:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x6a0d7965 (ffff8cfa12a49500) 00010000:00010000:2.0:1787707347.912326:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707347.912330:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec0e85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6a0d7965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707347.912335:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec0e85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6a0d7965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707347.912453:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+53:10482:x1874546707701888:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 Request processed in 765us (1169us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787707347.912460:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 73 00000100:00100000:1.0:1787707347.918291:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707347.918688:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707702016 00000100:00100000:0.0:1787707347.918697:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707702016 00000100:00100000:0.0:1787707347.918761:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 74 00000100:00100000:0.0:1787707347.918772:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+53:10482:x1874546707702016:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787707347.918793:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707347.918815:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0e8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d6f expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.918860:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0e93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.918874:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.918885:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.918993:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0e8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d6f expref: 55 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.919011:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0e93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d6f expref: 54 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.919020:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cfa19f4e900) 00010000:00010000:0.0:1787707347.919024:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787707347.919027:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2600, rc 0) 00000100:00100000:0.0:1787707347.919079:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+54:10482:x1874546707702016:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 310us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707347.919087:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 74 00000001:00080000:0.0:1787707347.922439:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:0.0:1787707347.922504:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:0.0:1787707347.922518:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1787707347.922532:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cfa30b42cc0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1787707347.922538:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfa2a543000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cfa10388c00 00000020:00080000:0.0:1787707347.922541:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfa2a543c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cfa3f94f800 00000100:00100000:0.0:1787707347.923283:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729751808:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787707347.923363:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707347.923663:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729751808 00000100:00100000:3.0:1787707347.923672:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729751808 00000100:00100000:3.0:1787707347.923744:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787707347.923756:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1874546729751808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787707347.923782:0:6688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1787707347.923814:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8e3fce, atime: 0x6a8e3fce, ctime: 0x6a8e3fce, blocks: 0x1 00010000:00010000:3.0:1787707347.923822:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec0e9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.923867:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=398s v=(0 0) 00010000:00010000:3.0:1787707347.923872:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707347.923879:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec0e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.923895:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec0e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.923905:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec0e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.923914:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec0e9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.926125:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787707347.926727:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3317:x1874546729751808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2971us (3361us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787707347.927389:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1787707347.927430:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707347.927438:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec0e9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.927449:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fca00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707347.927454:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec0e9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.927476:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec0e9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.927496:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec0e9a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.927504:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec0e9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.927526:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707347.927529:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707347.927531:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787707347.927650:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfa41a04000/2, rc 0, transno 4294967301 00000100:00100000:3.0:1787707347.927658:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729751808:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787707347.927721:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00080000:0.0:1787707347.927866:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787707347.932792:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707702272 00000100:00100000:3.0:1787707347.932808:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707702272 00000100:00100000:3.0:1787707347.932885:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 75 00000100:00100000:3.0:1787707347.932897:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+13:10482:x1874546707702272:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787707347.932987:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0ea1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.933004:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.933016:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787707347.933284:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1787707347.933294:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 398979923251ns, next at 399979920851ns, rc = 0 00000004:00010000:3.0:1787707347.933402:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad30d01a reply state 00000000c108bca6 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707347.933411:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787707347.933515:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+15:10482:x1874546707702272:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 Request processed in 620us (5793us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1787707347.933522:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 75 00000020:00080000:3.0:1787707347.934547:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1787707347.934642:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:3.0:1787707347.939317:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.939332:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0ea1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.939340:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0ea1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.939347:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707347.939351:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0ea1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.939359:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0ea1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.939400:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cfa19f4e900) 00010000:00010000:3.0:1787707347.939403:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787707347.939418:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0ea1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707347.939424:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0ea1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707347.939773:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707347.940397:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707702400 00000100:00100000:0.0:1787707347.940408:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707702400 00000100:00100000:0.0:1787707347.940461:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 76 00000100:00100000:0.0:1787707347.940472:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+14:10482:x1874546707702400:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787707347.940495:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707347.940513:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0ea8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d76 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.940570:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0ea8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d76 expref: 15 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.940583:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0ea8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d76 expref: 15 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707347.940603:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cfa19f4e900) 00010000:00010000:0.0:1787707347.940606:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787707347.940609:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2200, rc 0) 00000100:00100000:0.0:1787707347.940668:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+15:10482:x1874546707702400:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 197us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707347.940684:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 76 00000100:00100000:0.0:1787707347.947661:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707347.947744:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707702528 00000100:00100000:1.0:1787707347.947754:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707702528 00000100:00100000:1.0:1787707347.947801:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 25 00000100:00100000:1.0:1787707347.947810:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1874546707702528:12345-192.168.204.46@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1787707347.947855:0:6690:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-OST0000: connection from 9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp t0 exp 0000000000000000 cur 398 last 0 00000020:00000080:1.0:1787707347.947896:0:6690:0:(genops.c:1385:class_connect()) connect: client 9ed4058d-c366-401f-b84d-540fc0489f0c, cookie 0xc5f18d5f94ec0eaf 00002000:00100000:1.0:1787707347.947911:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9ed4058d-c366-401f-b84d-540fc0489f0c/ffff8cfa18484000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787707347.948091:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787707347.948341:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787707347.948399:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8cfa18483000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787707347.948601:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2358:x1874546707702528:12345-192.168.204.46@tcp:8:lhsmtool_posix.0 Request processed in 789us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707347.948610:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 25 00000100:00100000:3.0:1787707347.956366:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707347.956690:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707702656 00000100:00100000:0.0:1787707347.956699:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707702656 00000100:00100000:0.0:1787707347.956780:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 26 00000100:00100000:0.0:1787707347.956791:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+6:0:x1874546707702656:12345-192.168.204.46@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787707347.956995:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787707348.032474:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1787707348.032490:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9ed4058d-c366-401f-b84d-540fc0489f0c 00000100:00100000:0.0:1787707348.032692:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+5:0:x1874546707702656:12345-192.168.204.46@tcp:2:lhsmtool_posix.0 Request processed in 75897us (76330us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787707348.032703:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 26 00000100:00100000:3.0:1787707348.037219:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707348.037299:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707702912 00000100:00100000:0.0:1787707348.037308:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707702912 00000100:00100000:0.0:1787707348.037365:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 19 00000100:00100000:0.0:1787707348.037468:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+15:10482:x1874546707702912:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787707348.037837:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+16:10482:x1874546707702912:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 Request processed in 371us (626us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787707348.037846:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 19 00000100:00100000:2.0:1787707348.047457:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707348.047535:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707703168 00000100:00100000:3.0:1787707348.047546:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707703168 00000100:00100000:3.0:1787707348.047608:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 77 00000100:00100000:3.0:1787707348.047618:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+16:10482:x1874546707703168:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787707348.047754:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+16:10482:x1874546707703168:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 Request processed in 136us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707348.047763:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 77 00000100:00100000:2.0:1787707348.050756:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707348.051054:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707703296 00000100:00100000:3.0:1787707348.051066:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707703296 00000100:00100000:3.0:1787707348.051126:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 78 00000100:00100000:3.0:1787707348.051136:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+16:10482:x1874546707703296:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787707348.051154:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707348.051174:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0eb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d7d expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.051239:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0ebd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.051254:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.051276:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707348.051313:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787707348.051331:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.051360:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec0eb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d7d expref: 18 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.051403:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0ebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d7d expref: 17 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.051412:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cfa19f4e900) 00010000:00010000:3.0:1787707348.051416:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787707348.051419:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fca00, rc 0) 00000100:00100000:3.0:1787707348.051471:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+17:10482:x1874546707703296:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 337us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707348.051479:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 78 00000100:00100000:2.0:1787707348.057043:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707348.061154:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707703424 00000100:00100000:1.0:1787707348.061167:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707703424 00000100:00100000:1.0:1787707348.061229:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 27 00000100:00100000:1.0:1787707348.061239:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2362:x1874546707703424:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787707348.061258:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707348.061280:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f83de57/0xc5f18d5f94ec0ec4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d84 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787707348.061306:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8e3fd2, blocks: 0x1 00010000:00010000:1.0:1787707348.061325:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=399s v=(0 0) 00010000:00010000:1.0:1787707348.061329:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707348.061339:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f83de57/0xc5f18d5f94ec0ec4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d84 expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.061358:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f83de57/0xc5f18d5f94ec0ec4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d84 expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.061389:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d5a00, rc 0) 00000100:00100000:1.0:1787707348.061465:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2362:x1874546707703424:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 226us (4434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707348.061471:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 27 00000100:00100000:2.0:1787707348.065196:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707348.065274:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707703680 00000100:00100000:3.0:1787707348.065284:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707703680 00000100:00100000:3.0:1787707348.065345:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 79 00000100:00100000:3.0:1787707348.065356:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+17:10482:x1874546707703680:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787707348.065503:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+17:10482:x1874546707703680:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 Request processed in 148us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707348.065511:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 79 00000100:00100000:1.0:1787707348.073082:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707348.073881:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707703808 00000100:00100000:3.0:1787707348.073904:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707703808 00000100:00100000:3.0:1787707348.073983:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 28 00000100:00100000:3.0:1787707348.073995:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:10482:x1874546707703808:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787707348.074013:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707348.074031:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec0ecb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d8b expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.074063:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f83de57/0xc5f18d5f94ec0ec4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d84 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.074073:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707348.074077:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707348.074082:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec0ecb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d8b expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.074118:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f83de57/0xc5f18d5f94ec0ec4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d84 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.074133:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f83de57/0xc5f18d5f94ec0ec4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d84 expref: 7 pid: 6690 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707348.074148:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1874546729751936:192.168.204.46@tcp:104: 00000100:00100000:3.0:1787707348.074242:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0734cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787707348.081701:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707348.081911:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1874546729751936:192.168.204.46@tcp:104: 00010000:00010000:0.0:1787707348.081972:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec0ecb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d8b expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.081994:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fd400, rc 0) 00000100:00100000:0.0:1787707348.082054:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+7:10482:x1874546707703808:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 8061us (8981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707348.082063:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 28 00000100:00100000:2.0:1787707348.083479:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707703936 00000100:00100000:2.0:1787707348.083491:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707703936 00010000:00010000:2.0:1787707348.083534:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f83de57/0xc5f18d5f94ec0ec4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d84 expref: 7 pid: 6690 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707348.083571:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 42 00000100:00100000:2.0:1787707348.083582:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa113cec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2362:x1874546707703936:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787707348.083597:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707348.083623:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f83de57/0xc5f18d5f94ec0ec4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d84 expref: 7 pid: 6690 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.083637:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f83de57/0xc5f18d5f94ec0ec4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d84 expref: 7 pid: 6690 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.083660:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f83de57/0xc5f18d5f94ec0ec4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d84 expref: 7 pid: 6690 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.083676:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707348.083693:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707348.083703:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec0ecb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d8b expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.083713:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec0ecb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d8b expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.083788:0:8450:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec0ecb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d8b expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707348.083805:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8450:1874546729752064:192.168.204.46@tcp:105: 00000100:00100000:2.0:1787707348.083890:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f4bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787707348.093503:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707348.093893:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707704064 00000100:00100000:1.0:1787707348.093903:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707704064 00002000:00100000:1.0:1787707348.093962:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8cfa0871d880 x1874546707704064/t0(0) o4->9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp:239/0 lens 504/0 e 0 to 0 dl 1787707359 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787707348.093974:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa0871d880 with x1874546707704064 ext(0->8) 00002000:00010000:1.0:1787707348.093979:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfa0871d880 00000100:00100000:1.0:1787707348.094014:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 0 00000100:00100000:1.0:1787707348.094024:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2362:x1874546707704064:12345-192.168.204.46@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787707348.094715:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+9:2362:x1874546707704064:12345-192.168.204.46@tcp:4:lhsmtool_posix.0 Request processed in 691us (1219us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787707348.094735:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 0 00002000:00100000:1.0:1787707348.094743:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8cfa0871d880 x1874546707704064/t4294967302(0) o4->9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp:239/0 lens 504/448 e 0 to 0 dl 1787707359 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787707348.094750:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa0871d880 with x1874546707704064 ext(0->8) 00002000:00010000:1.0:1787707348.094754:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfa0871d880 00000100:00100000:3.0:1787707348.099014:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8450:1874546729752064:192.168.204.46@tcp:105: 00010000:00010000:3.0:1787707348.099061:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707348.099134:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa113cec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2362:x1874546707703936:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 15552us (17456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707348.099146:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 42 00000100:00100000:0.0:1787707348.117350:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707348.117561:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707704192 00000100:00100000:1.0:1787707348.117572:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707704192 00000100:00100000:1.0:1787707348.117641:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 80 00000100:00100000:1.0:1787707348.117652:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+17:10482:x1874546707704192:12345-192.168.204.46@tcp:44:lhsmtool_posix.0 00010000:00010000:2.0:1787707348.217511:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787707348.219459:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1787707348.219482:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:1.0:1787707348.219512:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787707348.219531:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1787707348.219540:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787707348.219672:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729752192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787707348.219741:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707348.219810:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729752192 00000100:00100000:1.0:1787707348.219817:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729752192 00000100:00100000:1.0:1787707348.219876:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787707348.219886:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729752192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787707348.220057:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787707348.220061:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787707346 00002000:00010000:1.0:1787707348.220063:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787707348.220066:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787707346 -> 1787707346 00002000:00010000:1.0:1787707348.220068:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787707348.220112:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1874546729752192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 227us (372us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787707348.220120:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787707348.220479:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+13:10482:x1874546707704192:12345-192.168.204.46@tcp:44:lhsmtool_posix.0 Request processed in 102826us (103134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707348.220488:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 80 00000100:00100000:0.0:1787707348.223555:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707348.223756:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707704320 00000100:00100000:2.0:1787707348.223768:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707704320 00000100:00100000:2.0:1787707348.223831:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 30 00000100:00100000:2.0:1787707348.223841:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2361:x1874546707704320:12345-192.168.204.46@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1787707348.224546:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfa41fd0000/2, rc 0, transno 4294967303 00000100:00100000:2.0:1787707348.224556:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729752192:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1787707348.303183:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1787707348.303203:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1787707348.304571:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2361:x1874546707704320:12345-192.168.204.46@tcp:16:lhsmtool_posix.0 Request processed in 80721us (81014us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707348.304584:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 30 00000100:00100000:0.0:1787707348.321367:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707348.321481:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707704576 00000100:00100000:1.0:1787707348.321492:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707704576 00000100:00100000:1.0:1787707348.321548:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 81 00000100:00100000:1.0:1787707348.321559:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+13:10482:x1874546707704576:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787707348.321612:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707348.321641:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec0ebd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d7d expref: 13 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.321688:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cfa19f4e900) 00010000:00010000:1.0:1787707348.321693:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787707348.321740:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.321753:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.321763:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787707348.322060:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e71100f reply state 000000005c70928d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707348.322070:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787707348.322174:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+14:10482:x1874546707704576:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 Request processed in 616us (817us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1787707348.322182:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 81 00010000:00010000:0.0:1787707348.331930:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.331961:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.331969:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.331975:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d5000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707348.331980:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.331987:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.332004:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cfa19f4e900) 00010000:00010000:0.0:1787707348.332007:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707348.332012:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.332018:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707348.348197:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707348.348853:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707704704 00000100:00100000:1.0:1787707348.348864:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707704704 00000100:00100000:1.0:1787707348.348930:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 31 00000100:00100000:1.0:1787707348.348952:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2359:x1874546707704704:12345-192.168.204.46@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787707348.349212:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787707348.349216:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787707346 -> 1787707345 00002000:00010000:1.0:1787707348.349218:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787707342 00002000:00010000:1.0:1787707348.349220:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787707346 -> 1787707345 00002000:00010000:1.0:1787707348.349223:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787707348.349305:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2359:x1874546707704704:12345-192.168.204.46@tcp:2:lhsmtool_posix.0 Request processed in 365us (1121us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787707348.349313:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 31 00000100:00100000:2.0:1787707348.353441:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707348.353539:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707704960 00000100:00100000:1.0:1787707348.353549:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707704960 00000100:00100000:1.0:1787707348.353602:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 82 00000100:00100000:1.0:1787707348.353613:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+13:10482:x1874546707704960:12345-192.168.204.46@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787707348.353684:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.353701:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0e93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d6f expref: 13 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.353711:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.353764:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0e93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d6f expref: 13 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.353779:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0e93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d6f expref: 13 pid: 8469 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707348.353794:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874546729752320:192.168.204.46@tcp:104: 00000100:00100000:1.0:1787707348.353898:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41900e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787707348.366279:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874546729752320:192.168.204.46@tcp:104: 00010000:00010000:2.0:1787707348.366309:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707348.371202:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707348.371353:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707705088 00000100:00100000:0.0:1787707348.371478:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707705088 00010000:00010000:0.0:1787707348.371522:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0e93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d6f expref: 14 pid: 8469 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707348.371597:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 43 00000100:00100000:0.0:1787707348.371609:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+14:2361:x1874546707705088:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707348.371623:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707348.371630:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0e93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d6f expref: 14 pid: 8469 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.371646:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0e93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d6f expref: 14 pid: 8469 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.371668:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0e93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d6f expref: 14 pid: 8469 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.371680:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cfa19f4e900) 00010000:00010000:0.0:1787707348.371686:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.371694:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.371701:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.371746:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707348.371805:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+13:2361:x1874546707705088:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 199us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707348.371835:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 43 00010000:00010000:3.0:1787707348.372170:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.372180:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.372214:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.372221:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.372227:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.372232:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d5000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707348.372236:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.372245:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.372257:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cfa19f4e900) 00010000:00010000:3.0:1787707348.372259:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787707348.372263:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.372292:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0ed9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707348.372344:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+12:10482:x1874546707704960:12345-192.168.204.46@tcp:55:lhsmtool_posix.0 Request processed in 18732us (18910us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787707348.372352:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 82 00000100:00100000:3.0:1787707348.376781:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707348.376955:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707705216 00000100:00100000:0.0:1787707348.376966:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707705216 00000100:00100000:0.0:1787707348.377027:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 32 00000100:00100000:0.0:1787707348.377038:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2361:x1874546707705216:12345-192.168.204.46@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787707348.377085:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec0ee0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.377107:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec0ecb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d8b expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.377115:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707348.377119:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787707348.377124:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec0ee0 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.377164:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec0ecb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d8b expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.377181:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec0ecb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d8b expref: 7 pid: 6688 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707348.377198:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1874546729752448:192.168.204.46@tcp:104: 00000100:00100000:0.0:1787707348.377299:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f5eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787707348.383758:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1874546729752448:192.168.204.46@tcp:104: 00010000:00010000:0.0:1787707348.383814:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec0ee0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707348.393346:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707348.393627:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707705344 00000100:00100000:0.0:1787707348.393639:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707705344 00010000:00010000:0.0:1787707348.393690:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec0ecb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d8b expref: 8 pid: 6688 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707348.393738:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 44 00000100:00100000:0.0:1787707348.393749:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2362:x1874546707705344:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707348.393764:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707348.393787:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec0ecb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d8b expref: 8 pid: 6688 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.393802:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec0ecb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d8b expref: 8 pid: 6688 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.393839:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec0ecb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d8b expref: 8 pid: 6688 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.393858:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787707348.393862:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787707348.393867:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec0ee0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.393877:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec0ee0 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.393929:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707348.394004:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2362:x1874546707705344:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 256us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707348.394012:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 44 00010000:00010000:0.0:1787707348.394039:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec0ee0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.394048:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec0ee0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.394072:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec0ee0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.394081:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec0ee0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.394088:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec0ee0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.394094:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2000 already unused, calling callback (ffffffffc1630230) 00010000:00010000:0.0:1787707348.394099:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec0ee0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.394108:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec0ee0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.394133:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec0ee0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.394141:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec0ee0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707348.394193:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2361:x1874546707705216:12345-192.168.204.46@tcp:1:lhsmtool_posix.0 Request processed in 17157us (17423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707348.394201:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 32 00000100:00100000:2.0:1787707348.404542:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707348.408464:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707705600 00000100:00100000:1.0:1787707348.408478:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707705600 00000100:00100000:1.0:1787707348.408540:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 83 00000100:00100000:1.0:1787707348.408551:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+12:10482:x1874546707705600:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787707348.408654:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0ee7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.408682:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.408694:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.409008:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0eee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.409020:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0ea8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d76 expref: 13 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.409028:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0eee lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.409062:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0ea8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d76 expref: 13 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.409077:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0ea8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d76 expref: 13 pid: 8469 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707348.409090:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874546729752576:192.168.204.46@tcp:104: 00000100:00100000:1.0:1787707348.409181:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41900d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787707348.417929:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707348.417975:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707705728 00000100:00100000:0.0:1787707348.417983:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707705728 00010000:00010000:0.0:1787707348.418022:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0ea8 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d76 expref: 14 pid: 8469 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707348.418058:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 45 00000100:00100000:0.0:1787707348.418068:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+14:2361:x1874546707705728:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707348.418081:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707348.418088:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0ea8 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d76 expref: 14 pid: 8469 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.418103:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0ea8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d76 expref: 14 pid: 8469 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.418125:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cfa19f4e900) 00010000:00010000:0.0:1787707348.418139:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0eee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.418150:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0eee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.418157:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0eee lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.418177:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707348.418233:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+14:2361:x1874546707705728:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 167us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707348.418241:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 45 00010000:00010000:2.0:1787707348.420076:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0ea8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d76 expref: 13 pid: 8469 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707348.420111:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874546729752576:192.168.204.46@tcp:104: 00010000:00010000:2.0:1787707348.420134:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0eee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.420143:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0eee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.420149:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0eee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787707348.420339:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1787707348.420513:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1787707348.420564:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1787707348.420667:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5857:1874546729752704:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787707348.420733:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707348.420766:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3f850240 going to sleep for 11 seconds 00000100:00100000:0.0:1787707348.421126:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729752704 00000100:00100000:0.0:1787707348.421136:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729752704 00000100:00100000:0.0:1787707348.421196:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787707348.421206:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1874546729752704:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787707348.421287:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1874546729752704:12345-0@lo:1000:mdt00_001.0 Request processed in 83us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707348.421295:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787707348.421538:0:5857:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1787707348.421544:0:5857:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfa41fd0000, transno 4294967303 00000100:00100000:2.0:1787707348.421658:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5857:1874546729752704:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787707348.422167:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1787707348.422236:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5857:1874546729752832:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787707348.422275:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707348.422352:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3f850a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787707348.431810:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729752832 00000100:00100000:0.0:1787707348.431825:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729752832 00000100:00100000:0.0:1787707348.440331:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787707348.440347:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1874546729752832:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787707348.440710:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5857:x1874546729752832:12345-0@lo:1000:mdt00_001.0 Request processed in 366us (18433us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787707348.440718:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787707348.443315:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5857:1874546729752832:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787707348.443392:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0eee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.443418:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0eee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.443426:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0eee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.443434:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d5000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707348.443439:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0eee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.443447:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0eee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.443464:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cfa19f4e900) 00010000:00010000:2.0:1787707348.443467:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787707348.443472:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0eee lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.443477:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0eee lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.443520:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec0e1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.443527:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec0e1c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.443533:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec0e1c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.443537:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707348.443547:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec0e1c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.443553:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec0e1c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.443561:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa143e4300) 00010000:00010000:2.0:1787707348.443564:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787707348.443567:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec0e1c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.443573:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec0e1c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.443597:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0ef5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.443611:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0e38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d5a expref: 16 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.443619:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0ef5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.443655:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0e38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d5a expref: 16 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.443674:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0e38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d5a expref: 16 pid: 5857 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707348.443689:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa1101ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874546729752960:192.168.204.46@tcp:104: 00000100:00100000:2.0:1787707348.443846:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3f850a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787707348.460198:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707348.460684:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707705856 00000100:00100000:3.0:1787707348.460696:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707705856 00010000:00010000:3.0:1787707348.460742:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0e38 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d5a expref: 17 pid: 5857 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707348.460784:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 46 00000100:00100000:3.0:1787707348.460793:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+17:2361:x1874546707705856:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787707348.460810:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707348.460818:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0e38 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d5a expref: 17 pid: 5857 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.460832:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0e38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d5a expref: 17 pid: 5857 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.460856:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa143e4300) 00010000:00010000:3.0:1787707348.460862:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0ef5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.460872:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0ef5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.460892:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0ef5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.460912:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707348.460981:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+17:2361:x1874546707705856:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 188us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707348.460989:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 46 00010000:00010000:2.0:1787707348.462159:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec0e38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d5a expref: 16 pid: 5857 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707348.462179:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa1101ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874546729752960:192.168.204.46@tcp:104: 00010000:00010000:2.0:1787707348.462200:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0ef5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.462210:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0ef5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.462216:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0ef5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.462229:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0ef5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.462235:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0ef5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.462243:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0ef5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.462249:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871ae00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707348.462254:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0ef5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.462261:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0ef5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.462273:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa143e4300) 00010000:00010000:2.0:1787707348.462275:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707348.462285:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0ef5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.462291:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0ef5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.462301:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.462306:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0ee7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.462311:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0ee7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.462317:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707348.462319:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0ee7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.462326:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0ee7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.462334:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa143e4300) 00010000:00010000:2.0:1787707348.462336:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787707348.462339:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0ee7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.462345:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0ee7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707348.463332:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+15:10482:x1874546707705600:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 Request processed in 54776us (58793us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1787707348.463344:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 83 00000020:00080000:2.0:1787707348.463355:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787707348.463491:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787707348.463496:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787707348.463535:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787707348.463544:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787707348.475809:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707348.475977:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707706112 00000100:00100000:2.0:1787707348.475989:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707706112 00000100:00100000:2.0:1787707348.476052:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 20 00000100:00100000:2.0:1787707348.476073:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+15:10482:x1874546707706112:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787707348.477208:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787707348.477334:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1787707348.478003:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0efc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.478025:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.478037:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.478047:0:5860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0efc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.478053:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0efc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.478060:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0efc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.478095:0:5860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787707348.478212:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+17:10482:x1874546707706112:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 Request processed in 2146us (2410us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787707348.478222:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 20 00000020:00080000:2.0:1787707348.478228:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787707348.478483:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707348.478492:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0efc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.478570:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871ae00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707348.478575:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0efc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.478583:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0efc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.478598:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cfa12a49600) 00010000:00010000:3.0:1787707348.478601:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787707348.478605:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0efc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.478611:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec0efc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.478627:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707348.478629:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707348.478630:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787707348.515152:0:12007:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787707348.515168:0:12007:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787707348.515215:0:12007:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787707348.515221:0:12007:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787707348.697059:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707348.702692:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707706368 00000100:00100000:3.0:1787707348.702708:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707706368 00000100:00100000:0.0:1787707348.703028:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 84 00000100:00100000:0.0:1787707348.703040:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+17:10493:x1874546707706368:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:0.0:1787707348.703074:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707348.703098:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0f03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d92 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.703366:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0f0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.703529:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0f0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.703540:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0f0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707348.703553:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787707348.703955:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec0f03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d92 expref: 20 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.703973:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0f0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d92 expref: 19 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.703982:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:0.0:1787707348.703985:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787707348.703989:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3400, rc 0) 00000100:00100000:0.0:1787707348.704182:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+19:10493:x1874546707706368:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 1142us (7145us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1787707348.704191:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 84 00000100:00100000:2.0:1787707348.709520:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707348.709663:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707706496 00000100:00100000:3.0:1787707348.709674:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707706496 00000100:00100000:3.0:1787707348.709734:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 85 00000100:00100000:3.0:1787707348.709746:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+19:10493:x1874546707706496:12345-192.168.204.46@tcp:34:lfs.0 00010000:00010000:3.0:1787707348.709835:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec0f18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.709852:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec0f18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.709864:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec0f18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.709879:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0f1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.709887:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.709894:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.712804:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.712833:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.712845:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787707348.712914:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.712928:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec0f18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.712944:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec0f18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.712951:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec0f18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.712958:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fda00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707348.712962:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec0f18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.712970:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec0f18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.712984:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:3.0:1787707348.712987:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707348.712992:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec0f18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.712999:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec0f18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.713012:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.713017:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0f1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.713030:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0f1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.713034:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707348.713037:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0f1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.713044:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0f1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.715624:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cfa143e4e00) 00010000:00010000:3.0:1787707348.715629:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707348.715636:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0f1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.715644:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0f1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.715667:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.715673:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.715679:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.715685:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707348.715688:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.715711:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.715722:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa143e4600) 00010000:00010000:3.0:1787707348.715725:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707348.715728:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.715735:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707348.715872:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+19:10493:x1874546707706496:12345-192.168.204.46@tcp:34:lfs.0 Request processed in 6122us (6369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707348.715884:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 85 00000100:00100000:3.0:1787707348.802580:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707348.802667:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707706752 00000100:00100000:1.0:1787707348.802677:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707706752 00000100:00100000:1.0:1787707348.802747:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 86 00000100:00100000:1.0:1787707348.802758:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+19:10496:x1874546707706752:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:1.0:1787707348.802780:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707348.802814:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0f2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9d99 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.802892:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0f34 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.802907:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0f34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.802918:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0f34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.802944:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0f3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.802952:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.802958:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.803279:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0f42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.803299:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.803307:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707348.803319:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787707348.803440:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0f34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.803448:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0f34 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.803455:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0f34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.803461:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d5a00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707348.803465:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0f34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.803472:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0f34 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.803484:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:1.0:1787707348.803487:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707348.803492:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0f34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.803499:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec0f34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.803530:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.803542:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0f3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.803549:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0f3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.803554:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707348.803557:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0f3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.803563:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0f3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.803584:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cfa204c6600) 00010000:00010000:1.0:1787707348.803587:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707348.803589:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0f3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.803594:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec0f3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.803637:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5e00/0xc5f18d5f94ec0f2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d99 expref: 22 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.803649:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0f42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d99 expref: 21 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.803655:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa204c6300) 00010000:00010000:1.0:1787707348.803658:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787707348.803666:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d5000, rc 0) 00000100:00100000:1.0:1787707348.803739:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+21:10496:x1874546707706752:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 983us (1168us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1787707348.803748:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 86 00000100:00100000:2.0:1787707348.810981:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707348.811057:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707706880 00000100:00100000:3.0:1787707348.811069:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707706880 00000100:00100000:3.0:1787707348.811125:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 87 00000100:00100000:3.0:1787707348.811136:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+21:10496:x1874546707706880:12345-192.168.204.46@tcp:54:lfs.0 00010000:00010000:3.0:1787707348.811207:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.811222:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.811233:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.811258:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.812139:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.812146:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.812153:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707348.812158:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.812166:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.812181:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa204c6300) 00010000:00010000:3.0:1787707348.812184:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787707348.812189:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.812195:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707348.815846:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+21:10496:x1874546707706880:12345-192.168.204.46@tcp:54:lfs.0 Request processed in 4694us (4855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707348.815861:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 87 00000100:00100000:3.0:1787707348.818612:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707348.818689:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707707136 00000100:00100000:2.0:1787707348.818701:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707707136 00000100:00100000:2.0:1787707348.818758:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 21 00000100:00100000:2.0:1787707348.818769:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa189ff850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+21:10496:x1874546707707136:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:2.0:1787707348.819010:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa189ff850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+22:10496:x1874546707707136:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 241us (407us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787707348.819017:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 21 00000100:00100000:2.0:1787707348.875187:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707348.875275:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707707392 00000100:00100000:1.0:1787707348.875287:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707707392 00000100:00100000:1.0:1787707348.875355:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 88 00000100:00100000:1.0:1787707348.875366:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+22:10024:x1874546707707392:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:1.0:1787707348.875620:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707348.875646:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14000/0xc5f18d5f94ec0f57 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9da0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.875750:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec0f5e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.875766:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0f42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d99 expref: 23 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.875775:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec0f5e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.875881:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0f42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d99 expref: 23 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.875896:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0f42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d99 expref: 23 pid: 5858 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707348.875911:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2a5b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874546729753088:192.168.204.46@tcp:104: 00000100:00100000:1.0:1787707348.876039:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41900300 going to sleep for 11 seconds 00000100:00100000:2.0:1787707348.879757:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707348.879863:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2a5b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874546729753088:192.168.204.46@tcp:104: 00010000:00010000:1.0:1787707348.879891:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec0f5e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707348.879977:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707707520 00000100:00100000:0.0:1787707348.879984:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707707520 00010000:00010000:0.0:1787707348.880039:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0f42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d99 expref: 24 pid: 5858 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707348.880096:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 47 00000100:00100000:0.0:1787707348.880106:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+24:2362:x1874546707707520:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707348.880121:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707348.880129:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0f42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d99 expref: 24 pid: 5858 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.880142:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0f42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d99 expref: 24 pid: 5858 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.880163:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec0f42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d99 expref: 24 pid: 5858 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.880178:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa204c6300) 00010000:00010000:0.0:1787707348.880182:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec0f5e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.880192:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec0f5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.880198:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec0f5e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707348.880225:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707348.880280:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+23:2362:x1874546707707520:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 175us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707348.880287:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 47 00010000:00010000:1.0:1787707348.880525:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec0f5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.880533:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec0f5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707348.880554:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787707348.880715:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14000/0xc5f18d5f94ec0f57 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9da0 expref: 24 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.880731:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec0f5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9da0 expref: 23 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.880739:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa204c6300) 00010000:00010000:1.0:1787707348.880742:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787707348.880744:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a14e00, rc 0) 00000100:00100000:1.0:1787707348.880780:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+23:10024:x1874546707707392:12345-192.168.204.46@tcp:101:bash.0 Request processed in 5416us (5603us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787707348.880788:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 88 00000100:00100000:2.0:1787707348.888132:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707348.894983:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707707776 00000100:00100000:3.0:1787707348.895001:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707707776 00000100:00100000:3.0:1787707348.895097:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 89 00000100:00100000:3.0:1787707348.895111:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+23:10024:x1874546707707776:12345-192.168.204.46@tcp:36:bash.0 00010000:00010000:3.0:1787707348.895451:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0f6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.895471:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0f6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.895498:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0f6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787707348.895569:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1787707348.895593:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006af7f11d reply state 00000000e99a22c0 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0f6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707348.895602:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787707348.895643:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1787707348.895762:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+27:10024:x1874546707707776:12345-192.168.204.46@tcp:36:bash.0 Request processed in 654us (7640us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1787707348.895770:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 89 00000020:00080000:3.0:1787707348.895775:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1787707348.898591:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0f6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.898609:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0f6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.898617:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0f6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.898623:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707348.898628:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0f6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.898650:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0f6c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.898667:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa204c6300) 00010000:00010000:2.0:1787707348.898670:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707348.898675:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0f6c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707348.898680:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec0f6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707348.899565:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707348.899990:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707707904 00000100:00100000:3.0:1787707348.899999:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707707904 00000100:00100000:3.0:1787707348.900072:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 90 00000100:00100000:3.0:1787707348.900083:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+26:10024:x1874546707707904:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:3.0:1787707348.900108:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707348.900129:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9da7 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.900196:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9da7 expref: 27 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.900211:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9da7 expref: 27 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707348.900231:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa204c6300) 00010000:00010000:3.0:1787707348.900245:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787707348.900250:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fc600, rc 0) 00000100:00100000:3.0:1787707348.900320:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+27:10024:x1874546707707904:12345-192.168.204.46@tcp:101:bash.0 Request processed in 237us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707348.900327:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 90 00000100:00100000:3.0:1787707348.905832:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707348.906466:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707708032 00000100:00100000:1.0:1787707348.906482:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707708032 00000100:00100000:1.0:1787707348.906578:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 33 00000100:00100000:1.0:1787707348.906591:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:10024:x1874546707708032:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:1.0:1787707348.906629:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707348.906651:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1e8c9ac/0xc5f18d5f94ec0f7a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9dae expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787707348.906681:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8e3fd1, atime: 0x6a8e3fce, ctime: 0x6a8e3fd1, blocks: 0xb 00010000:00010000:1.0:1787707348.906705:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=399s v=(0 0) 00010000:00010000:1.0:1787707348.906710:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707348.906719:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1e8c9ac/0xc5f18d5f94ec0f7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dae expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.906735:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b1e8c9ac/0xc5f18d5f94ec0f7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dae expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707348.906749:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a14600, rc 0) 00000100:00100000:1.0:1787707348.906822:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+7:10024:x1874546707708032:12345-192.168.204.46@tcp:101:bash.0 Request processed in 233us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707348.906830:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 33 00000100:00100000:3.0:1787707348.916613:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707348.916773:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707708160 00000100:00100000:2.0:1787707348.916784:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707708160 00002000:00010000:2.0:1787707348.916840:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787707348.916845:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa0871f800 with x1874546707708160 ext(0->18446744073709551615) 00002000:00010000:2.0:1787707348.916857:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfa0871f800. 00000100:00100000:2.0:1787707348.916903:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 1 00000100:00100000:2.0:1787707348.916913:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2361:x1874546707708160:12345-192.168.204.46@tcp:10:bash.0 00002000:00010000:2.0:1787707348.917201:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787707348.917205:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787707345 -> 1787707347 00002000:00010000:2.0:1787707348.917208:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787707342 -> 1787707342 00002000:00010000:2.0:1787707348.917210:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787707345 -> 1787707347 00002000:00010000:2.0:1787707348.917213:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787707348.917284:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2361:x1874546707708160:12345-192.168.204.46@tcp:10:bash.0 Request processed in 371us (681us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787707348.917292:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 1 00002000:00010000:2.0:1787707348.917308:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787707348.917311:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa0871f800 with x1874546707708160 ext(0->18446744073709551615) 00002000:00010000:2.0:1787707348.917317:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfa0871f800. 00000100:00100000:3.0:1787707349.102013:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707349.103625:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707708288 00000100:00100000:2.0:1787707349.103642:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707708288 00000100:00100000:2.0:1787707349.103762:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 91 00000100:00100000:2.0:1787707349.103773:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+27:10510:x1874546707708288:12345-192.168.204.46@tcp:34:lfs.0 00010000:00010000:2.0:1787707349.103866:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0f81 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.103899:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0f81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.103922:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0f81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.103953:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0f88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.103960:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0f88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.103967:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0f88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104281:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0f8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104292:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0f8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104299:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0f8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787707349.104351:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0f8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104364:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0f81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104426:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0f81 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104434:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0f81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104440:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871a800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707349.104445:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0f81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104451:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0f81 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104463:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:2.0:1787707349.104466:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707349.104471:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0f81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104477:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0f81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104489:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0f88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104495:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0f88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104508:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0f88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104513:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871ba00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707349.104516:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0f88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104523:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0f88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104531:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cfa12a49500) 00010000:00010000:2.0:1787707349.104533:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707349.104536:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0f88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104541:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0f88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104556:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0f8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104562:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0f8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104568:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0f8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104573:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707349.104575:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0f8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104591:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0f8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104599:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa204c6300) 00010000:00010000:2.0:1787707349.104602:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707349.104605:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0f8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.104610:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0f8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707349.104691:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+27:10510:x1874546707708288:12345-192.168.204.46@tcp:34:lfs.0 Request processed in 917us (2693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707349.104700:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 91 00000100:00080000:3.0:1787707349.107532:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707349.204619:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707349.207339:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707708544 00000100:00100000:0.0:1787707349.207407:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707708544 00000100:00100000:0.0:1787707349.207490:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 92 00000100:00100000:0.0:1787707349.207504:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+27:10513:x1874546707708544:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:0.0:1787707349.207533:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707349.207562:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0f96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9db5 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.207662:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0f9d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.207680:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0f9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.207694:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0f9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.207712:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0fa4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.207720:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0fa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.207728:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0fa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.208567:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0fab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.208585:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0fab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.208596:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0fab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707349.208620:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787707349.208743:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0f9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.208752:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0f9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.208760:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0f9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.208767:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707349.208773:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0f9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.208782:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0f9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.208797:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:0.0:1787707349.208807:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707349.208813:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0f9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.208821:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec0f9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.208836:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0fa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.208843:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0fa4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.208859:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0fa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.208865:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707349.208868:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0fa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.208875:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0fa4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.208884:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cfa19f4ed00) 00010000:00010000:0.0:1787707349.208886:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707349.208889:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0fa4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.210357:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec0fa4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.210483:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec0f96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9db5 expref: 30 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.210502:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0fab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9db5 expref: 29 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.210513:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa204c6300) 00010000:00010000:0.0:1787707349.210515:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787707349.210519:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2600, rc 0) 00000100:00100000:0.0:1787707349.210623:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+29:10513:x1874546707708544:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 3120us (6019us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1787707349.210653:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 92 00000100:00100000:1.0:1787707349.216300:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707349.216500:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707708672 00000100:00100000:2.0:1787707349.216510:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707708672 00000100:00100000:2.0:1787707349.216566:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 93 00000100:00100000:2.0:1787707349.216578:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+29:10513:x1874546707708672:12345-192.168.204.46@tcp:54:lfs.0 00010000:00010000:2.0:1787707349.216653:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0fb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.216671:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec0f5e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9da0 expref: 29 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.216682:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0fb9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.216719:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec0f5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9da0 expref: 29 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.216754:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec0f5e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9da0 expref: 29 pid: 5858 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707349.216769:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874546729753216:192.168.204.46@tcp:104: 00000100:00100000:2.0:1787707349.216880:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f4bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787707349.219654:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874546729753216:192.168.204.46@tcp:104: 00010000:00010000:2.0:1787707349.219684:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0fb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707349.228935:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707349.229717:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707708928 00000100:00100000:2.0:1787707349.229730:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707708928 00000100:00100000:2.0:1787707349.229814:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 22 00000100:00100000:2.0:1787707349.229826:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+30:5599:x1874546707708928:12345-192.168.204.46@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787707349.230171:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+31:5599:x1874546707708928:12345-192.168.204.46@tcp:35:ldlm_bl.0 Request processed in 346us (1261us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787707349.230180:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 22 00000100:00100000:3.0:1787707349.234498:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707349.234612:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707709056 00000100:00100000:0.0:1787707349.234632:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707709056 00010000:00010000:0.0:1787707349.234697:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec0f5e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9da0 expref: 31 pid: 5858 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707349.234762:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 48 00000100:00100000:0.0:1787707349.234774:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+31:2361:x1874546707709056:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707349.234796:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707349.234805:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec0f5e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9da0 expref: 31 pid: 5858 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.234823:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec0f5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9da0 expref: 31 pid: 5858 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.234854:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec0f5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9da0 expref: 31 pid: 5858 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.234877:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa204c6300) 00010000:00010000:0.0:1787707349.234884:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0fb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.234908:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.234917:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0fb9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.234983:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707349.235066:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+30:2361:x1874546707709056:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 293us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707349.235075:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 48 00010000:00010000:2.0:1787707349.236436:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.236452:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.236489:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.236497:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0fb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.236522:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.236528:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707349.236533:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.236540:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0fb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.236559:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa204c6300) 00010000:00010000:2.0:1787707349.236564:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787707349.236569:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0fb9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.236575:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0fb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707349.236664:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+29:10513:x1874546707708672:12345-192.168.204.46@tcp:54:lfs.0 Request processed in 20085us (20372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707349.236673:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 93 00010000:00010000:3.0:1787707349.242827:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707349.242946:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707349.243014:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707709312 00000100:00100000:0.0:1787707349.243032:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707709312 00000100:00100000:0.0:1787707349.243122:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 23 00000100:00100000:0.0:1787707349.243135:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+29:10513:x1874546707709312:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:0.0:1787707349.243491:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+30:10513:x1874546707709312:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 358us (550us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1787707349.243500:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 23 00000100:00100000:2.0:1787707349.305235:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729753728:0@lo:400:kworker.0 00000100:00100000:2.0:1787707349.305356:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707349.305481:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787707349.305491:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729753344:0@lo:400:kworker.0 00000100:00100000:2.0:1787707349.305532:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707349.305607:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729753600:0@lo:400:kworker.0 00000100:00100000:2.0:1787707349.305668:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707349.305936:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729753728 00000100:00100000:3.0:1787707349.305952:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729753728 00000100:00100000:3.0:1787707349.306018:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787707349.306029:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1874546729753728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707349.306888:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1874546729753728:12345-0@lo:400:kworker.0 Request processed in 858us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707349.306898:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1787707349.306946:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787707349.306986:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729753856:0@lo:400:kworker.0 00000100:00100000:1.0:1787707349.307000:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729753472:0@lo:400:kworker.0 00000100:00100000:3.0:1787707349.307034:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707349.307067:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707349.307112:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729753984:0@lo:400:kworker.0 00000100:00100000:3.0:1787707349.307117:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729753728:0@lo:400:kworker.0 00000100:00100000:1.0:1787707349.307157:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707349.307172:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729753600 00000100:00100000:3.0:1787707349.307180:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729753600 00000100:00080000:3.0:1787707349.307215:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707349.307255:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729753856 00000100:00100000:3.0:1787707349.307259:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729753856 00000100:00100000:1.0:1787707349.307272:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729753984 00000100:00100000:1.0:1787707349.307293:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729753984 00000100:00080000:3.0:1787707349.307296:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787707349.314669:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787707349.315083:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1874546729753984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707349.315765:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1874546729753984:12345-0@lo:400:kworker.0 Request processed in 722us (8611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707349.315775:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787707349.315882:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729753984:0@lo:400:kworker.0 00000100:00100000:1.0:1787707349.316574:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729753472 00000100:00100000:1.0:1787707349.317004:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729753472 00000100:00100000:1.0:1787707349.317058:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787707349.317069:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729753600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707349.319217:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729753344 00000100:00100000:2.0:1787707349.319235:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729753344 00000100:00100000:2.0:1787707349.319362:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787707349.319396:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729753344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707349.319506:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729753344:12345-0@lo:400:kworker.0 Request processed in 134us (13972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707349.319515:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787707349.319620:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787707349.319630:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729753472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707349.319688:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729753472:12345-0@lo:400:kworker.0 Request processed in 60us (12622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707349.319696:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1787707349.319752:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787707349.319803:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787707349.319810:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729753856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707349.319843:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729753856:12345-0@lo:400:kworker.0 Request processed in 34us (12811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707349.319849:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787707349.319900:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729753344:0@lo:400:kworker.0 00000100:00100000:2.0:1787707349.319930:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729753856:0@lo:400:kworker.0 00000100:00100000:1.0:1787707349.324635:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729753472:0@lo:400:kworker.0 00000100:00100000:1.0:1787707349.324762:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729753600:12345-0@lo:400:kworker.0 Request processed in 7693us (19092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707349.324774:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787707349.324823:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729753600:0@lo:400:kworker.0 00000001:00080000:3.0:1787707349.394355:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:3.0:1787707349.394393:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:3.0:1787707349.394403:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:0.0:1787707349.403750:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707349.403989:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707709568 00000100:00100000:2.0:1787707349.404004:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707709568 00000100:00100000:2.0:1787707349.404088:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 94 00000100:00100000:2.0:1787707349.404101:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+30:10524:x1874546707709568:12345-192.168.204.46@tcp:101:cat.0 00010000:00010000:2.0:1787707349.404157:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707349.404191:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0fc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9dbc expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.404296:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0fc7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.404313:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0fc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.404326:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0fc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.404344:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0fce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.404352:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0fce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.404359:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0fce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.404983:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec0fd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.404997:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec0fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.405005:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec0fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707349.405019:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787707349.405149:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0fc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.405158:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0fc7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.405166:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0fc7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.405173:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871ba00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707349.405178:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0fc7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.405187:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0fc7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.405201:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:2.0:1787707349.405204:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707349.405210:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0fc7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.405216:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec0fc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.405230:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0fce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.405236:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0fce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.405241:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0fce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.405246:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871a800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707349.405256:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0fce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.405263:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0fce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.405270:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cfa12a49200) 00010000:00010000:2.0:1787707349.405272:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707349.405274:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0fce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.405280:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec0fce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.405339:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec0fc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dbc expref: 33 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.405354:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec0fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dbc expref: 32 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.405361:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa204c6300) 00010000:00010000:2.0:1787707349.405364:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787707349.405367:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871be00, rc 0) 00000100:00100000:2.0:1787707349.405638:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+32:10524:x1874546707709568:12345-192.168.204.46@tcp:101:cat.0 Request processed in 1539us (1906us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787707349.405647:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 94 00000100:00100000:3.0:1787707349.415790:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707349.417135:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707709824 00000100:00100000:0.0:1787707349.417153:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707709824 00000100:00100000:0.0:1787707349.417327:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 24 00000100:00100000:0.0:1787707349.417342:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+32:10524:x1874546707709824:12345-192.168.204.46@tcp:35:cat.0 00000100:00100000:3.0:1787707349.418004:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+33:10524:x1874546707709824:12345-192.168.204.46@tcp:35:cat.0 Request processed in 657us (2223us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787707349.418018:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 24 00000100:00100000:3.0:1787707349.472164:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707349.473440:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707710080 00000100:00100000:1.0:1787707349.473459:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707710080 00000100:00100000:1.0:1787707349.473542:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 95 00000100:00100000:1.0:1787707349.473554:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+33:10525:x1874546707710080:12345-192.168.204.46@tcp:36:rm.0 00010000:00010000:1.0:1787707349.473635:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787707349.473674:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec0fd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dbc expref: 33 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.473705:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec0fab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9db5 expref: 32 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.473749:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec0f73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9da7 expref: 31 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.473763:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa204c6300) 00010000:00010000:1.0:1787707349.473776:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787707349.473805:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec0fe3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.473822:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec0fe3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.473833:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec0fe3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.473851:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15c00/0xc5f18d5f94ec0fea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.473858:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15c00/0xc5f18d5f94ec0fea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.473864:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15c00/0xc5f18d5f94ec0fea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.475813:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec0ff1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.475837:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec0ff1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.475849:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec0ff1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787707349.476741:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1787707349.476755:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 400523384241ns, next at 401523380613ns, rc = 0 00010000:00010000:1.0:1787707349.476843:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec0ff8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.476858:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec0ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.476869:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec0ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.476878:0:5858:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec0ff8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.476886:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec0ff8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.476894:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec0ff8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.476915:0:5858:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787707349.476953:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec0ff1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.476959:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec0ff1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.476965:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec0ff1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.476971:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707349.476984:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec0ff1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.476991:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec0ff1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.477005:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa204c6900) 00010000:00010000:1.0:1787707349.477008:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787707349.477012:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec0ff1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.477019:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec0ff1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.477041:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec0fe3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.477046:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec0fe3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.477052:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec0fe3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.477057:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14a00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707349.477060:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec0fe3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.477066:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec0fe3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.477074:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:1.0:1787707349.477076:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707349.477086:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec0fe3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.477092:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec0fe3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787707349.477105:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003336989e reply state 00000000d0fc5ecf transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15c00/0xc5f18d5f94ec0fea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.478588:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787707349.478603:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec0ff8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.478615:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14c00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:0.0:1787707349.478620:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec0ff8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.478629:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec0ff8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.478673:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cfa204c6900) 00010000:00010000:0.0:1787707349.478676:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787707349.478681:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec0ff8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.478687:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec0ff8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.478716:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707349.478719:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707349.478721:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707349.478887:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787707349.481238:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+32:10525:x1874546707710080:12345-192.168.204.46@tcp:36:rm.0 Request processed in 7668us (9073us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1787707349.481254:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 95 00010000:00010000:2.0:1787707349.486632:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15c00/0xc5f18d5f94ec0fea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.486656:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15c00/0xc5f18d5f94ec0fea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.486685:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15c00/0xc5f18d5f94ec0fea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.486691:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15c00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707349.486698:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15c00/0xc5f18d5f94ec0fea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.486717:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15c00/0xc5f18d5f94ec0fea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.486741:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cfa204c6700) 00010000:00010000:2.0:1787707349.486744:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707349.486750:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15c00/0xc5f18d5f94ec0fea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.486756:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15c00/0xc5f18d5f94ec0fea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707349.564579:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707349.564882:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707710336 00000100:00100000:0.0:1787707349.564897:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707710336 00000100:00100000:0.0:1787707349.564986:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 96 00000100:00100000:0.0:1787707349.564999:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+31:10531:x1874546707710336:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:0.0:1787707349.565041:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707349.565070:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec0fff lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9dc3 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.565241:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1006 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.565260:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1006 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.565273:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1006 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.565297:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec100d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.565325:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec100d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.565333:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec100d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787707349.566088:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1787707349.566300:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1014 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.566312:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.566321:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.566361:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1006 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.566396:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1006 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.566405:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1006 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.566413:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707349.566419:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1006 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.566428:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1006 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.566456:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:0.0:1787707349.566459:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707349.566465:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1006 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.566471:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1006 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787707349.566487:0:8469:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025c006bb reply state 00000000f727be82 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec100d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707349.566497:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787707349.566533:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec0fff lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dc3 expref: 34 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.566547:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dc3 expref: 33 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.566555:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e700) 00010000:00010000:0.0:1787707349.566558:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787707349.566560:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2000, rc 0) 00000100:00100000:0.0:1787707349.566657:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+34:10531:x1874546707710336:12345-192.168.204.46@tcp:101:bash.0 Request processed in 1659us (2091us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787707349.566667:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 96 00000100:00100000:0.0:1787707349.577812:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707349.577911:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707710464 00000100:00100000:1.0:1787707349.577935:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707710464 00000100:00100000:1.0:1787707349.578041:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 34 00000100:00100000:1.0:1787707349.578054:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2362:x1874546707710464:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:1.0:1787707349.578078:0:8265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707349.578105:0:8265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1022 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9dca expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787707349.578142:0:8265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787707349.578168:0:8265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787707349.578174:0:8265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707349.578186:0:8265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1022 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dca expref: 6 pid: 8265 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.578210:0:8265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1022 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dca expref: 6 pid: 8265 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.578265:0:8265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a14a00, rc 0) 00000100:00100000:1.0:1787707349.578337:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2362:x1874546707710464:12345-192.168.204.46@tcp:101:bash.0 Request processed in 284us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707349.578346:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 34 00010000:00010000:3.0:1787707349.579425:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec100d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.579441:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec100d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.579451:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec100d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.579458:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707349.579464:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec100d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.579473:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec100d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.579494:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cfa19f4ed00) 00010000:00010000:3.0:1787707349.579498:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707349.579503:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec100d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.579530:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec100d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787707349.579686:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787707349.583453:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707349.583647:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707710592 00000100:00100000:1.0:1787707349.583660:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707710592 00000100:00100000:1.0:1787707349.583739:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 35 00000100:00100000:1.0:1787707349.583753:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:10531:x1874546707710592:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:1.0:1787707349.583780:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707349.583822:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1029 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9dd1 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.583873:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1022 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dca expref: 7 pid: 8265 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.583885:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707349.583890:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707349.583895:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1029 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dd1 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.583952:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1022 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dca expref: 7 pid: 8265 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.583969:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1022 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dca expref: 7 pid: 8265 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707349.584006:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1874546729754112:192.168.204.46@tcp:104: 00000100:00100000:1.0:1787707349.584624:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41900cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707349.589112:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707349.589203:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707710720 00000100:00100000:0.0:1787707349.589214:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707710720 00010000:00010000:0.0:1787707349.589289:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1022 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dca expref: 8 pid: 8265 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707349.589346:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 49 00000100:00100000:0.0:1787707349.589358:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa113cf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2362:x1874546707710720:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707349.589408:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707349.589438:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1022 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dca expref: 8 pid: 8265 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.589457:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1022 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dca expref: 8 pid: 8265 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.589490:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707349.589495:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707349.589505:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1029 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dd1 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.589517:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1029 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dd1 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.589573:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1029 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dd1 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707349.589591:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4a4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5843:1874546729754240:192.168.204.46@tcp:105: 00000100:00100000:0.0:1787707349.589761:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f5eb40 going to sleep for 11 seconds 00010000:00010000:2.0:1787707349.590188:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1022 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dca expref: 8 pid: 8265 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707349.590209:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1874546729754112:192.168.204.46@tcp:104: 00010000:00010000:2.0:1787707349.590240:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1029 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dd1 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.590262:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a14400, rc 0) 00000100:00100000:2.0:1787707349.590314:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+7:10531:x1874546707710592:12345-192.168.204.46@tcp:101:bash.0 Request processed in 6565us (6875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707349.590334:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 35 00000100:00100000:1.0:1787707349.596483:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707349.596604:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4a4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5843:1874546729754240:192.168.204.46@tcp:105: 00010000:00010000:0.0:1787707349.596655:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707349.596723:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa113cf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2362:x1874546707710720:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 7366us (7626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707349.596736:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 49 00000100:00100000:2.0:1787707349.596880:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707710976 00000100:00100000:2.0:1787707349.596888:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707710976 00000100:00100000:2.0:1787707349.596951:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 25 00000100:00100000:2.0:1787707349.596961:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+33:10531:x1874546707710976:12345-192.168.204.46@tcp:35:bash.0 00000100:00100000:2.0:1787707349.597364:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+34:10531:x1874546707710976:12345-192.168.204.46@tcp:35:bash.0 Request processed in 404us (896us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787707349.597403:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 25 00000100:00100000:2.0:1787707349.816908:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787707349.816953:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729754368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787707349.817052:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707349.820083:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729754368 00000100:00100000:0.0:1787707349.820112:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729754368 00000100:00100000:0.0:1787707349.820217:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787707349.820230:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729754368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787707349.820284:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707349.820529:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729754368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 300us (3476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707349.820538:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787707349.820686:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1787707349.820695:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1787707349.820723:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfa41a04000, transno 4294967301 00000100:00100000:2.0:1787707349.820758:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729754368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787707349.842361:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707349.842527:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707711104 00000100:00100000:0.0:1787707349.842541:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707711104 00000100:00100000:0.0:1787707349.842683:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 97 00000100:00100000:0.0:1787707349.842698:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+34:10547:x1874546707711104:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:0.0:1787707349.842733:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707349.842762:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1030 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9dd8 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.842865:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1037 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.842881:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.842894:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707349.843009:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787707349.843013:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787707349.843041:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.843148:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1030 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dd8 expref: 36 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.843170:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dd8 expref: 35 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.843180:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:0.0:1787707349.843183:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787707349.843187:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3000, rc 0) 00000100:00100000:0.0:1787707349.843274:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+35:10547:x1874546707711104:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 579us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707349.843282:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 97 00000100:00100000:3.0:1787707349.848696:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707349.848940:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707711360 00000100:00100000:0.0:1787707349.848954:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707711360 00000100:00100000:0.0:1787707349.849036:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 98 00000100:00100000:0.0:1787707349.849058:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+35:10547:x1874546707711360:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:0.0:1787707349.849084:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707349.849112:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec103e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9ddf expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.849245:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1045 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.849295:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.849308:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707349.849322:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787707349.849517:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec103e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ddf expref: 38 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.849539:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ddf expref: 37 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.849550:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e700) 00010000:00010000:0.0:1787707349.849553:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787707349.849557:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2800, rc 0) 00000100:00100000:0.0:1787707349.849645:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+37:10547:x1874546707711360:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 598us (963us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1787707349.849653:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 98 00000100:00100000:3.0:1787707349.858293:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707349.858360:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707349.858470:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707711616 00000100:00100000:1.0:1787707349.858483:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707711616 00000100:00100000:1.0:1787707349.858565:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 99 00000100:00100000:1.0:1787707349.858578:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+37:10547:x1874546707711616:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:1.0:1787707349.858612:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707349.858640:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1053 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9de6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.858770:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec105a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.858799:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec105a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.858814:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec105a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707349.858827:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787707349.859001:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1053 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9de6 expref: 40 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.859022:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec105a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9de6 expref: 39 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.859056:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e700) 00010000:00010000:1.0:1787707349.859059:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787707349.859064:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a15000, rc 0) 00000100:00100000:1.0:1787707349.859149:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+39:10547:x1874546707711616:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 573us (872us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1787707349.859158:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 99 00000100:00100000:0.0:1787707349.862403:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707711744 00000100:00100000:0.0:1787707349.862424:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707711744 00000100:00100000:1.0:1787707349.862684:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 6 00000100:00100000:1.0:1787707349.862696:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a591500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+39:2359:x1874546707711744:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787707349.862720:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707349.862752:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1045 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ddf expref: 39 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.862777:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e700) 00010000:00010000:1.0:1787707349.862782:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707349.862873:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a591500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+38:2359:x1874546707711744:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 178us (4511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707349.862879:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 6 00000100:00100000:1.0:1787707349.873954:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707349.874155:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707711872 00000100:00100000:3.0:1787707349.874171:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707711872 00000100:00100000:3.0:1787707349.874245:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 36 00000100:00100000:3.0:1787707349.874266:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2362:x1874546707711872:12345-192.168.204.46@tcp:1:lfs.0 00010000:00010000:3.0:1787707349.874331:0:8265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000211dc432/0xc5f18d5f94ec1068 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.874357:0:8265:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1029 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dd1 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.874367:0:8265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707349.874412:0:8265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787707349.874419:0:8265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000211dc432/0xc5f18d5f94ec1068 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.874465:0:8265:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1029 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dd1 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.874482:0:8265:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1029 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dd1 expref: 6 pid: 6690 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707349.874521:0:8265:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2a591880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8265:1874546729754496:192.168.204.46@tcp:104: 00000100:00100000:3.0:1787707349.874637:0:8265:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f4b000 going to sleep for 11 seconds 00000100:00100000:3.0:1787707349.879016:0:8265:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2a591880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8265:1874546729754496:192.168.204.46@tcp:104: 00010000:00010000:3.0:1787707349.879071:0:8265:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000211dc432/0xc5f18d5f94ec1068 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707349.880215:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707349.880327:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707712000 00000100:00100000:3.0:1787707349.880339:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707712000 00002000:00100000:3.0:1787707349.880518:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8cfa3fcbc000 x1874546707712000/t0(0) o4->9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp:240/0 lens 504/0 e 0 to 0 dl 1787707360 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787707349.880531:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa3fcbc000 with x1874546707712000 ext(0->8) 00010000:00010000:3.0:1787707349.880543:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1029 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dd1 expref: 7 pid: 6690 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.880562:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1029 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dd1 expref: 7 pid: 6690 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787707349.880570:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cfa3fcbc000 00000100:00100000:3.0:1787707349.880604:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 1 00000100:00100000:3.0:1787707349.880615:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2362:x1874546707712000:12345-192.168.204.46@tcp:4:lfs.0 00000100:00100000:3.0:1787707349.881230:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+9:2362:x1874546707712000:12345-192.168.204.46@tcp:4:lfs.0 Request processed in 614us (1020us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787707349.881238:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 1 00002000:00100000:3.0:1787707349.881253:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8cfa3fcbc000 x1874546707712000/t4294967302(0) o4->9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp:240/0 lens 504/448 e 0 to 0 dl 1787707360 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787707349.881262:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa3fcbc000 with x1874546707712000 ext(0->8) 00010000:00010000:3.0:1787707349.881269:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1029 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dd1 expref: 9 pid: 6690 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.881283:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1029 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dd1 expref: 9 pid: 6690 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787707349.881291:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cfa3fcbc000 00000100:00100000:0.0:1787707349.886010:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707349.886429:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707712128 00000100:00100000:3.0:1787707349.886442:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707712128 00010000:00010000:3.0:1787707349.886707:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1029 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dd1 expref: 9 pid: 6690 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707349.886801:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 50 00000100:00100000:3.0:1787707349.886816:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+9:2362:x1874546707712128:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787707349.886836:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787707349.886861:0:5842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787707349.886865:0:5842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787707348 00002000:00010000:3.0:1787707349.886868:0:5842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787707348 00002000:00010000:3.0:1787707349.886870:0:5842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787707348 00010000:00010000:3.0:1787707349.886877:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1029 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dd1 expref: 9 pid: 6690 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.886895:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1029 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dd1 expref: 9 pid: 6690 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.886965:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1029 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dd1 expref: 9 pid: 6690 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.886986:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787707349.886992:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787707349.886999:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000211dc432/0xc5f18d5f94ec1068 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.887012:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000211dc432/0xc5f18d5f94ec1068 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.887069:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707349.887164:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2362:x1874546707712128:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 351us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707349.887173:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 50 00010000:00010000:1.0:1787707349.887708:0:8265:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000211dc432/0xc5f18d5f94ec1068 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.887722:0:8265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000211dc432/0xc5f18d5f94ec1068 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.887770:0:8265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000211dc432/0xc5f18d5f94ec1068 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.887779:0:8265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000211dc432/0xc5f18d5f94ec1068 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.887797:0:8265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000211dc432/0xc5f18d5f94ec1068 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.887807:0:8265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc600 already unused, calling callback (ffffffffc1630230) 00010000:00010000:1.0:1787707349.887812:0:8265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000211dc432/0xc5f18d5f94ec1068 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.887823:0:8265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000211dc432/0xc5f18d5f94ec1068 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.887839:0:8265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000211dc432/0xc5f18d5f94ec1068 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.887846:0:8265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000211dc432/0xc5f18d5f94ec1068 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707349.887929:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2362:x1874546707711872:12345-192.168.204.46@tcp:1:lfs.0 Request processed in 13663us (13988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707349.887938:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 36 00000100:00100000:0.0:1787707349.893000:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707349.893129:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707712384 00000100:00100000:2.0:1787707349.893143:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707712384 00000100:00100000:2.0:1787707349.893328:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 26 00000100:00100000:2.0:1787707349.893341:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa189ff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+38:10547:x1874546707712384:12345-192.168.204.46@tcp:35:lfs.0 00000004:00010000:2.0:1787707349.893545:0:5859:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec105a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9de6 expref: 38 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787707349.893883:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1787707349.893955:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1787707349.894365:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1787707349.894489:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec106f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.894509:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1014 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dc3 expref: 42 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.894519:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec106f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.894565:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dc3 expref: 42 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.894585:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1014 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dc3 expref: 42 pid: 8469 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707349.894603:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa06ecc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874546729754624:192.168.204.46@tcp:104: 00000100:00100000:2.0:1787707349.894712:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3acae900 going to sleep for 11 seconds 00000100:00100000:2.0:1787707349.899854:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa06ecc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874546729754624:192.168.204.46@tcp:104: 00010000:00010000:2.0:1787707349.899902:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec106f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707349.901078:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707349.901708:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707712512 00000100:00100000:2.0:1787707349.901720:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707712512 00010000:00010000:2.0:1787707349.901779:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1014 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dc3 expref: 43 pid: 8469 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707349.901834:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 51 00000100:00100000:2.0:1787707349.901847:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a591880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+43:2361:x1874546707712512:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787707349.901887:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707349.901907:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1014 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dc3 expref: 43 pid: 8469 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.901936:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dc3 expref: 43 pid: 8469 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.901966:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1014 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dc3 expref: 43 pid: 8469 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.901987:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e700) 00010000:00010000:2.0:1787707349.901993:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec106f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.902005:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec106f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.902014:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec106f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707349.902485:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707349.902572:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a591880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+42:2361:x1874546707712512:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 725us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707349.902583:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 51 00010000:00010000:1.0:1787707349.903218:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec106f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707349.903230:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec106f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787707349.903518:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787707349.903906:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1787707349.904206:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874546729754752:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787707349.904285:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707349.904765:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41900cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707349.905354:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729754752 00000100:00100000:0.0:1787707349.905367:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729754752 00000100:00100000:1.0:1787707349.905571:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787707349.905584:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5859:x1874546729754752:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787707349.905744:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5859:x1874546729754752:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 162us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707349.905753:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787707349.905926:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874546729754752:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787707349.906720:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1787707349.907989:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2a593100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874546729754880:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787707349.908072:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707349.909465:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f4b000 going to sleep for 11 seconds 00000100:00100000:1.0:1787707349.909952:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729754880 00000100:00100000:1.0:1787707349.909964:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729754880 00000100:00100000:1.0:1787707349.910087:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787707349.910101:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5859:x1874546729754880:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787707349.910504:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5859:x1874546729754880:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 404us (2430us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787707349.910514:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787707349.910611:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2a593100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874546729754880:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787707349.910706:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1787707349.910766:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec106f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.910782:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec106f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.910824:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec106f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.910832:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871a800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707349.910837:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec106f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.910846:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec106f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.910868:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e700) 00010000:00010000:3.0:1787707349.910872:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787707349.910878:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec106f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707349.910885:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec106f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787707349.911146:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787707349.911271:0:5859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1787707349.911286:0:5859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 400957914674ns, next at 401957912251ns, rc = 0 00000001:00080000:3.0:1787707349.911294:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1787707349.911331:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e700) 00010000:00010000:3.0:1787707349.911334:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787707349.911344:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec105a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9de6 expref: 46 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707349.911523:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa189ff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+45:10547:x1874546707712384:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 18184us (18536us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1787707349.911544:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 26 00000020:00080000:3.0:1787707349.911549:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787707349.917559:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707349.918076:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707712640 00000100:00100000:0.0:1787707349.918090:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707712640 00000100:00100000:0.0:1787707349.918207:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 100 00000100:00100000:0.0:1787707349.918220:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+45:10547:x1874546707712640:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:0.0:1787707349.918304:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707349.918343:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec1076 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9ded expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.918460:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec1076 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ded expref: 46 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.918478:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec1076 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ded expref: 46 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707349.918504:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:0.0:1787707349.918508:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787707349.918512:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2600, rc 0) 00000100:00100000:0.0:1787707349.918597:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+46:10547:x1874546707712640:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 379us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707349.918605:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 100 00000100:00100000:2.0:1787707349.923505:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707349.923643:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707712896 00000100:00100000:0.0:1787707349.923658:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707712896 00000100:00100000:0.0:1787707349.923801:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 27 00000100:00100000:0.0:1787707349.923815:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+46:10547:x1874546707712896:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:0.0:1787707349.924145:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+47:10547:x1874546707712896:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 333us (655us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1787707349.924153:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 27 00000100:00100000:3.0:1787707350.059120:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707350.061717:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707713024 00000100:00100000:1.0:1787707350.061752:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707713024 00000100:00100000:1.0:1787707350.061863:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 101 00000100:00100000:1.0:1787707350.061878:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+47:10557:x1874546707713024:12345-192.168.204.46@tcp:34:lfs.0 00010000:00010000:1.0:1787707350.062005:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec107d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.062053:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec107d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.062070:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec107d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.062092:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1084 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.062101:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.062107:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.062239:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec108b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.062248:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec108b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.062255:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec108b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787707350.064256:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec108b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.064291:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec107d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.064300:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec107d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.064336:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec107d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.064342:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707350.064347:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec107d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.064356:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec107d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.064598:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:1.0:1787707350.064603:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707350.064610:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec107d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.064618:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec107d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.064640:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.064647:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1084 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.064653:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.064658:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707350.064662:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.064680:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1084 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.064690:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cfa204c6300) 00010000:00010000:1.0:1787707350.064693:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707350.064696:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1084 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.064702:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1084 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.064724:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec108b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.064731:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec108b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.064737:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec108b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.064743:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707350.064746:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec108b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.064753:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec108b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.064760:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:1.0:1787707350.064763:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707350.064767:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec108b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.064785:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec108b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707350.065315:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+47:10557:x1874546707713024:12345-192.168.204.46@tcp:34:lfs.0 Request processed in 3433us (6207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707350.065328:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 101 00000100:00100000:1.0:1787707350.133594:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707350.133733:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707713280 00000100:00100000:2.0:1787707350.133761:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707713280 00000100:00100000:2.0:1787707350.133896:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 102 00000100:00100000:2.0:1787707350.133925:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+47:10560:x1874546707713280:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:2.0:1787707350.133951:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707350.133978:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec1092 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9df4 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134088:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1099 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134105:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1099 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134118:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1099 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134134:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec10a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134140:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec10a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134146:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec10a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134308:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec10a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134316:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec10a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134323:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec10a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707350.134340:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787707350.134524:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1099 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134532:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1099 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134538:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1099 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134544:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871bc00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707350.134548:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1099 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134557:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1099 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134570:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:2.0:1787707350.134573:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707350.134578:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1099 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134584:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1099 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134599:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec10a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134605:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec10a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134622:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec10a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134627:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871a800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707350.134630:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec10a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134636:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec10a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134643:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cfa12a49200) 00010000:00010000:2.0:1787707350.134646:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707350.134649:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec10a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134655:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec10a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134702:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec1092 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9df4 expref: 50 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134717:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec10a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9df4 expref: 49 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.134724:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:2.0:1787707350.134726:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787707350.134729:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871ba00, rc 0) 00000100:00100000:2.0:1787707350.134818:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+49:10560:x1874546707713280:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 911us (1238us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1787707350.134836:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 102 00000100:00100000:2.0:1787707350.147707:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707350.148008:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707713408 00000100:00100000:0.0:1787707350.148018:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707713408 00000100:00100000:0.0:1787707350.148078:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 103 00000100:00100000:0.0:1787707350.148088:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+49:10560:x1874546707713408:12345-192.168.204.46@tcp:54:lfs.0 00010000:00010000:0.0:1787707350.148203:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec10b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.148221:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec10b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.148233:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec10b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.148258:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec10b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.148265:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec10b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.148271:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec10b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.148278:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707350.148283:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec10b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.148290:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec10b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.148301:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:0.0:1787707350.148305:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787707350.148309:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec10b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.148315:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec10b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707350.149135:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+49:10560:x1874546707713408:12345-192.168.204.46@tcp:54:lfs.0 Request processed in 1044us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707350.149144:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 103 00000100:00100000:3.0:1787707350.153501:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707350.159159:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707713664 00000100:00100000:1.0:1787707350.159184:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707713664 00000100:00100000:1.0:1787707350.159297:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 28 00000100:00100000:1.0:1787707350.159312:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+49:10560:x1874546707713664:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:1.0:1787707350.161073:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+50:10560:x1874546707713664:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 1749us (7573us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1787707350.161089:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 28 00000100:00100000:1.0:1787707350.263719:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707350.263923:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707713920 00000100:00100000:0.0:1787707350.263936:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707713920 00000100:00100000:0.0:1787707350.264019:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 104 00000100:00100000:0.0:1787707350.264043:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+50:10570:x1874546707713920:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:0.0:1787707350.264080:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707350.264084:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787707350.264122:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1037 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dd8 expref: 50 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.264147:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:0.0:1787707350.264152:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787707350.264168:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec10bc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9dfb expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.264292:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec10c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.264307:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec10c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.264319:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec10c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707350.264331:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787707350.268138:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec10bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dfb expref: 52 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.268201:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec10c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dfb expref: 51 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.268212:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:0.0:1787707350.268215:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787707350.268219:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2000, rc 0) 00000100:00100000:0.0:1787707350.268333:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+51:10570:x1874546707713920:12345-192.168.204.46@tcp:101:bash.0 Request processed in 4300us (4628us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787707350.268346:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 104 00010000:00010000:3.0:1787707350.270681:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707350.278860:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707350.279085:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707714176 00000100:00100000:1.0:1787707350.279098:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707714176 00000100:00100000:1.0:1787707350.279181:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 105 00000100:00100000:1.0:1787707350.279193:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+51:10570:x1874546707714176:12345-192.168.204.46@tcp:36:bash.0 00010000:00010000:1.0:1787707350.279275:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787707350.279312:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec10c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dfb expref: 51 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.279339:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec10a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9df4 expref: 50 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.280177:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:1.0:1787707350.280183:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787707350.280494:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec10d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.280510:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec10d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.280523:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec10d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787707350.280584:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1787707350.280616:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038d20803 reply state 000000003171bda8 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec10d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707350.280627:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787707350.280772:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+52:10570:x1874546707714176:12345-192.168.204.46@tcp:36:bash.0 Request processed in 1577us (1925us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1787707350.280791:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 105 00000020:00080000:1.0:1787707350.280800:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787707350.287261:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec10d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.287287:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec10d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.287295:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec10d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.287303:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707350.287308:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec10d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.287316:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec10d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.287340:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:2.0:1787707350.287344:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707350.287350:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec10d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.287356:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec10d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707350.290190:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707350.290556:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707714304 00000100:00100000:1.0:1787707350.290569:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707714304 00000100:00100000:1.0:1787707350.290768:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 106 00000100:00100000:1.0:1787707350.290791:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+51:10570:x1874546707714304:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:1.0:1787707350.290829:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707350.290860:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec10d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e02 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.291025:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec10df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.291058:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec10df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.291073:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec10df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707350.291112:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787707350.291118:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787707350.291142:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec10df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.291175:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec10d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e02 expref: 53 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.291198:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec10df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e02 expref: 52 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.291207:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:1.0:1787707350.291210:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787707350.291214:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a15800, rc 0) 00000100:00100000:1.0:1787707350.291312:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+52:10570:x1874546707714304:12345-192.168.204.46@tcp:101:bash.0 Request processed in 532us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707350.291320:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 106 00000100:00100000:3.0:1787707350.301221:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707350.302507:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707714560 00000100:00100000:2.0:1787707350.302525:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707714560 00000100:00100000:2.0:1787707350.302606:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 29 00000100:00100000:2.0:1787707350.302649:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+52:10570:x1874546707714560:12345-192.168.204.46@tcp:35:bash.0 00000100:00100000:2.0:1787707350.302940:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+53:10570:x1874546707714560:12345-192.168.204.46@tcp:35:bash.0 Request processed in 294us (1733us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1787707350.302948:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 29 00000100:00100000:3.0:1787707350.386188:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707350.388740:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707714688 00000100:00100000:0.0:1787707350.388762:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707714688 00000100:00100000:0.0:1787707350.389008:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 107 00000100:00100000:0.0:1787707350.389023:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+53:10576:x1874546707714688:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:0.0:1787707350.389059:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707350.389091:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec10e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e09 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.389177:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec10ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.389194:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec10ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.389208:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec10ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707350.390769:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787707350.393976:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787707350.394080:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec10ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.394147:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec10e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e09 expref: 55 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.394172:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec10ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e09 expref: 54 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.394183:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:0.0:1787707350.394186:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787707350.394191:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3a00, rc 0) 00000100:00100000:0.0:1787707350.394296:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+54:10576:x1874546707714688:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 5275us (8121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707350.394305:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 107 00000100:00100000:2.0:1787707350.411216:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707350.411436:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707714816 00000100:00100000:0.0:1787707350.411450:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707714816 00000100:00100000:0.0:1787707350.411525:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 108 00000100:00100000:0.0:1787707350.411538:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+54:10576:x1874546707714816:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:0.0:1787707350.411565:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707350.411592:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec10f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e10 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.411988:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec10fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.412007:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec10fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.412043:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec10fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.412064:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1102 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.412073:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.412079:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.412210:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1109 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.412283:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.412292:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707350.412336:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787707350.412341:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787707350.412362:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.412426:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.412437:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec10fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.412455:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec10fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.412463:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec10fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.412470:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707350.412475:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec10fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.413433:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec10fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.413451:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:0.0:1787707350.413454:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707350.413460:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec10fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.413467:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec10fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.413488:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.413494:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1102 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.413500:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.413506:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707350.413525:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.413532:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1102 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.413542:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cfa19f4e700) 00010000:00010000:0.0:1787707350.413544:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707350.413547:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1102 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.413553:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1102 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.413608:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec10f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e10 expref: 56 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.413623:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e10 expref: 55 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.414877:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:0.0:1787707350.414881:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787707350.414885:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2200, rc 0) 00000100:00100000:2.0:1787707350.416634:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+55:10576:x1874546707714816:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 5082us (5416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707350.416650:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 108 00000100:00100000:3.0:1787707350.432807:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707350.432930:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707714944 00000100:00100000:0.0:1787707350.432946:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707714944 00000100:00100000:0.0:1787707350.433035:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 7 00000100:00100000:0.0:1787707350.433048:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f051180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+55:2359:x1874546707714944:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707350.433068:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707350.433115:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1109 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e10 expref: 55 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.433158:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:0.0:1787707350.433164:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707350.433242:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f051180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+54:2359:x1874546707714944:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 196us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707350.433250:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 7 00000100:00100000:3.0:1787707350.443125:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707350.443822:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707715200 00000100:00100000:1.0:1787707350.443836:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707715200 00000100:00100000:1.0:1787707350.443945:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 109 00000100:00100000:1.0:1787707350.443958:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+54:10576:x1874546707715200:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:1.0:1787707350.443986:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707350.444016:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec1110 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e17 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.444152:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1117 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.444171:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec10df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e02 expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.444182:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1117 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.444227:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec10df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e02 expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.444245:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec10df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e02 expref: 55 pid: 5856 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707350.444259:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874546729755008:192.168.204.46@tcp:104: 00000100:00100000:1.0:1787707350.444701:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa12a4f180 going to sleep for 11 seconds 00000100:00100000:2.0:1787707350.451439:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707350.451685:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707715328 00000100:00100000:3.0:1787707350.451698:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707715328 00010000:00010000:3.0:1787707350.451751:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec10df lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e02 expref: 56 pid: 5856 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707350.451803:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 52 00000100:00100000:3.0:1787707350.451813:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+56:2361:x1874546707715328:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787707350.451832:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707350.451840:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec10df lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e02 expref: 56 pid: 5856 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.452018:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec10df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e02 expref: 56 pid: 5856 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.452049:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:3.0:1787707350.452054:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1117 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.452079:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1117 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.452088:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1117 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.452112:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787707350.452292:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec10df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e02 expref: 56 pid: 5856 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707350.452312:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874546729755008:192.168.204.46@tcp:104: 00010000:00010000:1.0:1787707350.452335:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1117 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.452352:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1117 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.452358:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1117 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707350.452418:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787707350.452637:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec1110 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e17 expref: 57 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.452654:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1117 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e17 expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.452662:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:1.0:1787707350.452665:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787707350.452667:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a14400, rc 0) 00000100:00100000:3.0:1787707350.453785:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+56:2361:x1874546707715328:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 1964us (2353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707350.453801:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 52 00000100:00100000:1.0:1787707350.455451:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+55:10576:x1874546707715200:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 11483us (12329us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787707350.455466:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 109 00000100:00100000:3.0:1787707350.469620:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707350.474137:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707715584 00000100:00100000:0.0:1787707350.474159:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707715584 00000100:00100000:0.0:1787707350.474283:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 8 00000100:00100000:0.0:1787707350.474296:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f053800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+55:10576:x1874546707715584:12345-192.168.204.46@tcp:103:lfs.0 00010000:00010000:0.0:1787707350.474319:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707350.474354:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec1076 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ded expref: 55 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.474417:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:0.0:1787707350.474423:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707350.474519:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f053800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+54:10576:x1874546707715584:12345-192.168.204.46@tcp:103:lfs.0 Request processed in 224us (4913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707350.474528:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 8 00000100:00100000:2.0:1787707350.485498:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707350.485611:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707715712 00000100:00100000:1.0:1787707350.485634:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707715712 00000100:00100000:1.0:1787707350.485714:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 110 00000100:00100000:1.0:1787707350.485726:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+54:10576:x1874546707715712:12345-192.168.204.46@tcp:58:lfs.0 00010000:00010000:1.0:1787707350.486117:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec1125 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.486140:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec1125 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.486162:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec1125 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787707350.486970:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787707350.487118:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+54:10576:x1874546707715712:12345-192.168.204.46@tcp:58:lfs.0 Request processed in 1388us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707350.487129:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 110 00000100:00100000:2.0:1787707350.508554:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707350.508680:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707715840 00000100:00100000:0.0:1787707350.508694:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707715840 00000100:00100000:0.0:1787707350.508773:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 111 00000100:00100000:0.0:1787707350.508787:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+54:10576:x1874546707715840:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:0.0:1787707350.508821:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707350.508867:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec112c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e1e expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.508982:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec1125 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.508995:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec112c lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e1e expref: 55 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.509021:0:5857:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec1125 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.509035:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec112c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e1e expref: 55 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.509052:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:0.0:1787707350.509056:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787707350.509060:0:5857:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec112c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e1e expref: 55 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.509068:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2600, rc 0) 00000100:00100000:0.0:1787707350.509152:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+55:10576:x1874546707715840:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 367us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707350.509161:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 111 00000040:00080000:1.0:1787707350.520956:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787707350.520970:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787707350.521030:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787707350.521042:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787707350.521217:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbf800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874546729755136:192.168.204.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787707350.522780:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2a62f900 going to sleep for 11 seconds 00000100:00100000:1.0:1787707350.533749:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbf800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874546729755136:192.168.204.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787707350.545691:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707350.549440:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707715968 00000100:00100000:0.0:1787707350.549462:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707715968 00000100:00100000:1.0:1787707350.549699:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 112 00000100:00100000:1.0:1787707350.549713:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+55:10577:x1874546707715968:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787707350.549765:0:8469:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787707350.549957:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+55:10577:x1874546707715968:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 Request processed in 245us (4279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707350.549966:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 112 00000100:00100000:2.0:1787707350.558584:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707350.558747:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707716096 00000100:00100000:0.0:1787707350.558762:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707716096 00000100:00100000:0.0:1787707350.558844:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 113 00000100:00100000:0.0:1787707350.558867:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+55:10577:x1874546707716096:12345-192.168.204.46@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787707350.559002:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1133 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.559025:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1133 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.559040:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1133 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.560547:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec113a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.563064:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec113a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.563082:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec113a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.563828:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1141 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.563845:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.563854:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707350.563911:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787707350.563915:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787707350.563931:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.563944:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1133 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.563968:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1133 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.563975:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1133 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.563982:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707350.563986:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1133 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.563995:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1133 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.564008:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfa06897a00) 00010000:00010000:0.0:1787707350.564011:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707350.564015:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1133 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.564022:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1133 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.564038:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec113a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.564044:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec113a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.564050:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec113a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.564055:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707350.564064:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec113a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.564070:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec113a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.564078:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8cfa19f4e700) 00010000:00010000:0.0:1787707350.564080:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707350.564083:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec113a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.564089:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec113a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.564105:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.564110:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1141 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.566362:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.566397:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707350.566402:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.566412:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1141 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.566440:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:0.0:1787707350.566443:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707350.566464:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1141 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.566471:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1141 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707350.566587:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+55:10577:x1874546707716096:12345-192.168.204.46@tcp:34:lhsmtool_posix.0 Request processed in 7718us (8015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707350.566599:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 113 00000100:00100000:3.0:1787707350.579966:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707350.580082:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707716352 00000100:00100000:1.0:1787707350.580098:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707716352 00000100:00100000:1.0:1787707350.580196:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 114 00000100:00100000:1.0:1787707350.580207:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+55:10577:x1874546707716352:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787707350.580229:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707350.580253:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1148 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e25 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.580354:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec114f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.580605:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec114f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.580617:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec114f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707350.580630:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787707350.580813:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec114f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.580822:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec114f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.580829:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec114f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.580835:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15a00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707350.580840:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec114f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.580847:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec114f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.580858:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:1.0:1787707350.580862:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787707350.580866:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec114f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.580871:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec114f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.580927:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1148 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e25 expref: 57 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.580946:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfa06897a00) 00010000:00010000:1.0:1787707350.580948:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787707350.580952:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1148 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e25 expref: 57 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.580962:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a15800, rc 0) 00000100:00100000:1.0:1787707350.581044:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+56:10577:x1874546707716352:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 838us (1092us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1787707350.581051:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 114 00000100:00100000:2.0:1787707350.591463:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707350.591540:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707716480 00000100:00100000:1.0:1787707350.591551:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707716480 00000100:00100000:1.0:1787707350.591602:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 115 00000100:00100000:1.0:1787707350.591612:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+56:10577:x1874546707716480:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787707350.591650:0:5858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787707350.591765:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+56:10577:x1874546707716480:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 Request processed in 154us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707350.591782:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 115 00000100:00100000:3.0:1787707350.595211:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707350.595434:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707716736 00000100:00100000:1.0:1787707350.595444:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707716736 00000100:00100000:1.0:1787707350.595507:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 116 00000100:00100000:1.0:1787707350.595518:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+56:10577:x1874546707716736:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787707350.595540:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707350.595544:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787707350.595572:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec10ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e09 expref: 56 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.595609:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:1.0:1787707350.595613:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787707350.595627:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec115d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e2c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787707350.596062:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1787707350.600153:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1164 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.600177:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.600190:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.600258:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec115d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e2c expref: 58 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.600280:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1164 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e2c expref: 57 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.600299:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cfa143e4600) 00010000:00010000:3.0:1787707350.600313:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787707350.600317:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fda00, rc 0) 00000100:00100000:3.0:1787707350.600503:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+57:10577:x1874546707716736:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 4985us (5300us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1787707350.600522:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 116 00000100:00100000:3.0:1787707350.605255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707350.605615:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707716992 00000100:00100000:2.0:1787707350.605625:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707716992 00000100:00100000:2.0:1787707350.605879:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 117 00000100:00100000:2.0:1787707350.605893:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+57:10577:x1874546707716992:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787707350.605969:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707350.605998:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1164 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e2c expref: 57 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.606497:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cfa143e4600) 00010000:00010000:2.0:1787707350.606508:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787707350.606530:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1172 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.606662:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1172 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.606673:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1172 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.606879:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec1179 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x44c9cf9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.606889:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec1179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x44c9cf9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.606908:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec1179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x44c9cf9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.606988:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1172 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.606995:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1172 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.607002:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1172 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.607007:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707350.607011:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1172 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.607109:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1172 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.607121:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:2.0:1787707350.607124:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707350.607128:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1172 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.607134:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1172 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.607144:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec1179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x44c9cf9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.607149:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec1179 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x44c9cf9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.607155:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec1179 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x44c9cf9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.607160:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871ae00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707350.607162:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec1179 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x44c9cf9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.607168:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec1179 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x44c9cf9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.607175:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x44c9cf9e (ffff8cfa12a49200) 00010000:00010000:2.0:1787707350.607178:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707350.607180:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec1179 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x44c9cf9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.607196:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec1179 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x44c9cf9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707350.607293:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+56:10577:x1874546707716992:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 Request processed in 1401us (2515us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787707350.607302:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 117 00000100:00100000:2.0:1787707350.610651:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707350.610804:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707717120 00000100:00100000:0.0:1787707350.610814:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707717120 00000100:00100000:0.0:1787707350.610869:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 118 00000100:00100000:0.0:1787707350.610880:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+56:10577:x1874546707717120:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787707350.610913:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707350.610939:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1180 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e33 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.610975:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.610988:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.610999:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.611111:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1180 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e33 expref: 58 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.611129:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e33 expref: 57 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.611147:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cfa19f4e700) 00010000:00010000:0.0:1787707350.611151:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787707350.611155:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3000, rc 0) 00000100:00100000:0.0:1787707350.612551:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+57:10577:x1874546707717120:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 1664us (1900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707350.612562:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 118 00000100:00100000:3.0:1787707350.618990:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707350.619433:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707717376 00000100:00100000:0.0:1787707350.619445:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707717376 00000100:00100000:0.0:1787707350.619521:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 119 00000100:00100000:0.0:1787707350.619532:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+57:10577:x1874546707717376:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787707350.619634:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec118e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.619650:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec118e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.619661:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec118e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787707350.620713:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1787707350.620727:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 401667356218ns, next at 402667353342ns, rc = 0 00000004:00010000:0.0:1787707350.621475:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c8189f2 reply state 000000002168be3d transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec118e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707350.621488:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787707350.621742:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+59:10577:x1874546707717376:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 Request processed in 2207us (2759us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1787707350.621767:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 119 00010000:00010000:3.0:1787707350.626863:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec118e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.626884:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec118e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.626893:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec118e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.626911:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707350.626917:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec118e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.626925:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec118e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.626949:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cfa19f4e700) 00010000:00010000:3.0:1787707350.626952:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787707350.626957:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec118e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.626964:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec118e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707350.627766:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707350.628137:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707717504 00000100:00100000:3.0:1787707350.628165:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707717504 00000100:00100000:3.0:1787707350.628231:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 120 00000100:00100000:3.0:1787707350.628241:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+58:10577:x1874546707717504:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787707350.628269:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707350.628291:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec1195 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e3a expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.628357:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec1195 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e3a expref: 59 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.628399:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec1195 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e3a expref: 59 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.628421:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cfa19f4e700) 00010000:00010000:3.0:1787707350.628425:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787707350.628427:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fd200, rc 0) 00000100:00100000:3.0:1787707350.628575:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+59:10577:x1874546707717504:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 334us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707350.628581:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 120 00000100:00100000:2.0:1787707350.635947:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707350.636960:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707717632 00000100:00100000:3.0:1787707350.636976:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707717632 00000100:00080000:0.0:1787707350.637065:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787707350.637149:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 37 00000100:00100000:3.0:1787707350.637161:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2361:x1874546707717632:12345-192.168.204.46@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787707350.637644:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+9:2361:x1874546707717632:12345-192.168.204.46@tcp:2:lhsmtool_posix.0 Request processed in 484us (1706us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787707350.637652:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 37 00000100:00100000:2.0:1787707350.640262:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707350.640406:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707717888 00000100:00100000:1.0:1787707350.640417:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707717888 00000100:00100000:1.0:1787707350.640549:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 30 00000100:00100000:1.0:1787707350.640562:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+59:10577:x1874546707717888:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787707350.640795:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+60:10577:x1874546707717888:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 Request processed in 235us (543us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1787707350.640803:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 30 00000100:00100000:0.0:1787707350.644770:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707350.644952:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707718144 00000100:00100000:2.0:1787707350.644963:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707718144 00000100:00100000:2.0:1787707350.645341:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 121 00000100:00100000:2.0:1787707350.645354:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+60:10577:x1874546707718144:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787707350.645529:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+60:10577:x1874546707718144:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 Request processed in 177us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707350.645537:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 121 00000100:00100000:3.0:1787707350.648142:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707350.648447:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707718272 00000100:00100000:0.0:1787707350.648459:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707718272 00000100:00100000:0.0:1787707350.648515:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 122 00000100:00100000:0.0:1787707350.648528:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+60:10577:x1874546707718272:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787707350.648549:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707350.648571:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec119c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e41 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.648635:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec11a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.648649:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec11a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.648659:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec11a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707350.648692:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787707350.648721:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec11a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.648745:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec119c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e41 expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.648761:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec11a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e41 expref: 61 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.648792:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cfa19f4e700) 00010000:00010000:0.0:1787707350.648795:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787707350.648799:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2000, rc 0) 00000100:00100000:0.0:1787707350.648859:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+61:10577:x1874546707718272:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 334us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707350.648866:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 122 00000100:00100000:3.0:1787707350.654916:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707350.655559:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707718400 00000100:00100000:1.0:1787707350.655571:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707718400 00000100:00100000:1.0:1787707350.655641:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 38 00000100:00100000:1.0:1787707350.655653:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+9:2361:x1874546707718400:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787707350.655671:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707350.655692:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c803188/0xc5f18d5f94ec11aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e48 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787707350.655719:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8e3fd5, blocks: 0x1 00010000:00010000:1.0:1787707350.655738:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=401s v=(0 0) 00010000:00010000:1.0:1787707350.655743:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707350.655765:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c803188/0xc5f18d5f94ec11aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e48 expref: 10 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.655786:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006c803188/0xc5f18d5f94ec11aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e48 expref: 10 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.655801:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a15a00, rc 0) 00000100:00100000:1.0:1787707350.655872:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+10:2361:x1874546707718400:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 221us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707350.655879:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 38 00000100:00100000:2.0:1787707350.659094:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707350.659397:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707718656 00000100:00100000:0.0:1787707350.659408:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707718656 00000100:00100000:0.0:1787707350.659501:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 123 00000100:00100000:0.0:1787707350.659511:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+61:10577:x1874546707718656:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787707350.659615:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+61:10577:x1874546707718656:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 Request processed in 105us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707350.659622:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 123 00000100:00100000:2.0:1787707350.662569:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707350.662652:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707718784 00000100:00100000:1.0:1787707350.662663:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707718784 00000100:00100000:1.0:1787707350.662728:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 39 00000100:00100000:1.0:1787707350.662740:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+10:10577:x1874546707718784:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787707350.662757:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707350.662776:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec11b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e4f expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.662824:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006c803188/0xc5f18d5f94ec11aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e48 expref: 11 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.662833:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707350.662838:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707350.662843:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec11b1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e4f expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.662880:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006c803188/0xc5f18d5f94ec11aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e48 expref: 11 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.662921:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006c803188/0xc5f18d5f94ec11aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e48 expref: 11 pid: 6688 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707350.662935:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1874546729755264:192.168.204.46@tcp:104: 00000100:00100000:1.0:1787707350.663032:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2a62f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787707350.665848:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1874546729755264:192.168.204.46@tcp:104: 00010000:00010000:1.0:1787707350.665884:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec11b1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e4f expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.665917:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a14a00, rc 0) 00000100:00100000:1.0:1787707350.665980:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+11:10577:x1874546707718784:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 3240us (3418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707350.665988:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 39 00000100:00100000:2.0:1787707350.667681:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707350.667765:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707718912 00000100:00100000:1.0:1787707350.667774:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707718912 00010000:00010000:1.0:1787707350.667824:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006c803188/0xc5f18d5f94ec11aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e48 expref: 11 pid: 6688 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707350.667869:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 53 00000100:00100000:1.0:1787707350.667880:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa113cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+11:2361:x1874546707718912:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787707350.667908:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707350.667932:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006c803188/0xc5f18d5f94ec11aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e48 expref: 11 pid: 6688 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.667969:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006c803188/0xc5f18d5f94ec11aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e48 expref: 11 pid: 6688 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.667996:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c803188/0xc5f18d5f94ec11aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e48 expref: 11 pid: 6688 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.668015:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707350.668019:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707350.668029:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec11b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e4f expref: 10 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.668040:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec11b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e4f expref: 10 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.668079:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec11b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e4f expref: 10 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707350.668094:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5841:1874546729755392:192.168.204.46@tcp:105: 00000100:00100000:1.0:1787707350.668187:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2a62f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787707350.673154:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5841:1874546729755392:192.168.204.46@tcp:105: 00010000:00010000:1.0:1787707350.673184:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707350.673261:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa113cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+10:2361:x1874546707718912:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 5381us (5586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707350.673277:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 53 00000100:00100000:3.0:1787707350.674811:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707350.675088:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707719040 00000100:00100000:1.0:1787707350.675098:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707719040 00002000:00100000:1.0:1787707350.675147:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8cfa41c95180 x1874546707719040/t0(0) o4->9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp:241/0 lens 504/0 e 0 to 0 dl 1787707361 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787707350.675158:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa41c95180 with x1874546707719040 ext(0->12) 00002000:00010000:1.0:1787707350.675163:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfa41c95180 00000100:00100000:1.0:1787707350.675189:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 2 00000100:00100000:1.0:1787707350.675199:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+10:2362:x1874546707719040:12345-192.168.204.46@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787707350.676558:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+12:2362:x1874546707719040:12345-192.168.204.46@tcp:4:lhsmtool_posix.0 Request processed in 1353us (1746us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787707350.676569:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 2 00002000:00100000:1.0:1787707350.676580:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8cfa41c95180 x1874546707719040/t4294967308(0) o4->9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp:241/0 lens 504/448 e 0 to 0 dl 1787707361 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787707350.676589:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa41c95180 with x1874546707719040 ext(0->12) 00002000:00010000:1.0:1787707350.676596:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfa41c95180 00000100:00100000:2.0:1787707350.681605:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707350.681960:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707719168 00000100:00100000:0.0:1787707350.681971:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707719168 00000100:00100000:3.0:1787707350.682073:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 124 00000100:00100000:3.0:1787707350.682086:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+61:10577:x1874546707719168:12345-192.168.204.46@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787707350.716827:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:3.0:1787707350.716840:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:3.0:1787707350.716873:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1787707350.716913:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787707350.716938:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cfa3acaee40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1787707350.716944:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfa418e1800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cfa3acae900 00000020:00080000:3.0:1787707350.716948:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfa418e1900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cfa41a30400 00000020:00080000:3.0:1787707350.716985:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cfa3f850240 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1787707350.716988:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfa06f0ad00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cfa3f850cc0 00000020:00080000:3.0:1787707350.716991:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfa06f0ae00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cf901f2e800 00000004:00080000:3.0:1787707350.717002:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:3.0:1787707350.717235:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729755520:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787707350.717302:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707350.717345:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787707350.717351:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729755648:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787707350.717389:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707350.717416:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729755520 00000100:00100000:3.0:1787707350.717422:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729755520 00000100:00100000:3.0:1787707350.717459:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729755648 00000100:00100000:3.0:1787707350.717462:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729755648 00000100:00100000:3.0:1787707350.717480:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787707350.717489:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1874546729755520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787707350.717525:0:8265:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1787707350.717552:0:8265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e59ec068/0xc5f18d5f94ec11b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.717575:0:8265:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1e8c9ac/0xc5f18d5f94ec0f7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dae expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.717584:0:8265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787707350.717589:0:8265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787707350.717595:0:8265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e59ec068/0xc5f18d5f94ec11b8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.717629:0:8265:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b1e8c9ac/0xc5f18d5f94ec0f7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dae expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.717645:0:8265:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b1e8c9ac/0xc5f18d5f94ec0f7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dae expref: 11 pid: 6690 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707350.717655:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787707350.717657:0:8265:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8265:1874546729755776:192.168.204.46@tcp:104: 00000100:00100000:1.0:1787707350.717664:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1874546729755648:12345-0@lo:2:osp-syn-0-0.0 00000020:00080000:0.0:1787707350.717801:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787707350.717982:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787707350.718077:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729755904:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787707350.718113:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707350.718243:0:8265:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3cbd59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787707350.718258:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787707350.718264:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1787707350.718392:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729755904 00000100:00100000:3.0:1787707350.718398:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729755904 00000100:00100000:3.0:1787707350.718477:0:12022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787707350.718484:0:12022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3316:x1874546729755904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787707350.718501:0:12022:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1787707350.718531:0:12022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8e3fd4, atime: 0x6a8e3fd4, ctime: 0x6a8e3fd4, blocks: 0x1 00010000:00010000:3.0:1787707350.718538:0:12022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec11bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.718550:0:12022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1787707350.718553:0:12022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707350.718558:0:12022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec11bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.718574:0:12022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec11bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.718584:0:12022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec11bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.718593:0:12022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec11bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.718608:0:12022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787707350.718618:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707350.718624:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec11bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.718632:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd400 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707350.718636:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec11bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787707350.718655:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00010000:00010000:3.0:1787707350.718656:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec11bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787707350.718658:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787707349 00002000:00010000:1.0:1787707350.718661:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787707350.718663:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787707349 -> 1787707349 00002000:00010000:1.0:1787707350.718665:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787707350.718710:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3314:x1874546729755648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1047us (1320us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787707350.718717:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1787707350.718756:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec11bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.718764:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec11bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787707350.718768:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfa35b01c00/2, rc 0, transno 4294967309 00000100:00100000:1.0:1787707350.718774:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729755648:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1787707350.718782:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707350.718784:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707350.718786:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707350.718845:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+15:10577:x1874546707719168:12345-192.168.204.46@tcp:44:lhsmtool_posix.0 Request processed in 36761us (37249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707350.718853:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 124 00000100:00100000:3.0:1787707350.721798:0:12022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3316:x1874546729755904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3289us (3658us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787707350.721815:0:12022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787707350.723432:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000004:00080000:2.0:1787707350.723461:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfa2f4a5880/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787707350.723465:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707350.723472:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729755904:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787707350.723526:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707719296 00000100:00100000:1.0:1787707350.723534:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707719296 00000100:00100000:0.0:1787707350.723539:0:8265:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8265:1874546729755776:192.168.204.46@tcp:104: 00010000:00010000:0.0:1787707350.723566:0:8265:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e59ec068/0xc5f18d5f94ec11b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707350.723594:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 43 00000100:00100000:0.0:1787707350.723594:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707719424 00000100:00100000:0.0:1787707350.723597:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707719424 00000100:00100000:1.0:1787707350.723604:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+13:2362:x1874546707719296:12345-192.168.204.46@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1787707350.723620:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b1e8c9ac/0xc5f18d5f94ec0f7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dae expref: 13 pid: 6690 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707350.723659:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 54 00000100:00100000:0.0:1787707350.723679:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+13:2361:x1874546707719424:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707350.723692:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707350.723699:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b1e8c9ac/0xc5f18d5f94ec0f7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dae expref: 13 pid: 6690 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.723711:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b1e8c9ac/0xc5f18d5f94ec0f7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dae expref: 13 pid: 6690 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.723735:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1e8c9ac/0xc5f18d5f94ec0f7a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9dae expref: 13 pid: 6690 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.723750:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787707350.723755:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787707350.723761:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e59ec068/0xc5f18d5f94ec11b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.723781:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e59ec068/0xc5f18d5f94ec11b8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.723804:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707350.723852:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+12:2361:x1874546707719424:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 173us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707350.723859:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 54 00010000:00010000:0.0:1787707350.723888:0:8265:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e59ec068/0xc5f18d5f94ec11b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.723922:0:8265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e59ec068/0xc5f18d5f94ec11b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.723932:0:8265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e59ec068/0xc5f18d5f94ec11b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.723938:0:8265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e59ec068/0xc5f18d5f94ec11b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.723954:0:8265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787707350.724515:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3314:x1874546729755520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7025us (7211us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787707350.724522:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1787707350.724542:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787707350.724549:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e59ec068/0xc5f18d5f94ec11b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.724558:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd600 already unused, calling callback (ffffffffc1630230) 00010000:00010000:0.0:1787707350.724562:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e59ec068/0xc5f18d5f94ec11b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.724572:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e59ec068/0xc5f18d5f94ec11b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.724597:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e59ec068/0xc5f18d5f94ec11b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.724604:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e59ec068/0xc5f18d5f94ec11b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.724623:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707350.724625:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707350.724627:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787707350.725257:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfa35b01880/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787707350.725265:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729755520:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1787707350.817099:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1787707350.817120:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1787707350.817268:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2362:x1874546707719296:12345-192.168.204.46@tcp:16:lhsmtool_posix.0 Request processed in 93660us (93840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707350.817279:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 43 00000100:00100000:3.0:1787707350.822184:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707350.822341:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707719680 00000100:00100000:2.0:1787707350.822352:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707719680 00000100:00100000:2.0:1787707350.822436:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 125 00000100:00100000:2.0:1787707350.822448:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+15:10577:x1874546707719680:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787707350.822513:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707350.822545:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec11a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e41 expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.822565:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cfa19f4e700) 00010000:00010000:2.0:1787707350.822571:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787707350.822605:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.822630:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.822645:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787707350.822940:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da11724f reply state 00000000dc4a86a3 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707350.822950:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787707350.823296:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+16:10577:x1874546707719680:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 Request processed in 849us (1122us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787707350.823305:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 125 00010000:00010000:2.0:1787707350.827812:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.827830:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.827854:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.827860:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707350.827865:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.827873:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.827901:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cfa19f4e700) 00010000:00010000:2.0:1787707350.827904:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707350.827909:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.827916:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707350.834474:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707350.838332:0:12022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707719808 00000100:00100000:3.0:1787707350.838351:0:12022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707719808 00000100:00100000:3.0:1787707350.841941:0:12022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 44 00000100:00100000:3.0:1787707350.841956:0:12022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2359:x1874546707719808:12345-192.168.204.46@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787707350.842201:0:12022:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787707350.842218:0:12022:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787707349 -> 1787707349 00002000:00010000:3.0:1787707350.842221:0:12022:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787707348 00002000:00010000:3.0:1787707350.842223:0:12022:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787707349 -> 1787707349 00002000:00010000:3.0:1787707350.842225:0:12022:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787707350.842382:0:12022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2359:x1874546707719808:12345-192.168.204.46@tcp:2:lhsmtool_posix.0 Request processed in 415us (7902us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787707350.842392:0:12022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 44 00000100:00100000:0.0:1787707350.850289:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707350.850409:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707720064 00000100:00100000:2.0:1787707350.850419:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707720064 00000100:00100000:2.0:1787707350.850504:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 126 00000100:00100000:2.0:1787707350.850515:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+15:10577:x1874546707720064:12345-192.168.204.46@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787707350.850590:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.850609:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1187 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e33 expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.850636:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11cd lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.851061:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e33 expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.851078:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1187 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e33 expref: 15 pid: 5856 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707350.851094:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874546729756032:192.168.204.46@tcp:104: 00000100:00100000:2.0:1787707350.851229:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa12a4f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787707350.859149:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707350.859417:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707720192 00000100:00100000:3.0:1787707350.859426:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707720192 00010000:00010000:3.0:1787707350.859466:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1187 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e33 expref: 16 pid: 5856 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707350.859515:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 55 00000100:00100000:3.0:1787707350.859526:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+16:2362:x1874546707720192:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787707350.859542:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707350.859549:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1187 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e33 expref: 16 pid: 5856 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.859564:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1187 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e33 expref: 16 pid: 5856 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.859599:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cfa19f4e700) 00010000:00010000:3.0:1787707350.859605:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.859614:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.859641:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11cd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.859958:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707350.860015:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+16:2362:x1874546707720192:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 490us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707350.860023:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 55 00010000:00010000:2.0:1787707350.863492:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1187 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e33 expref: 15 pid: 5856 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707350.863520:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874546729756032:192.168.204.46@tcp:104: 00010000:00010000:2.0:1787707350.863546:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.863556:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.863561:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.864207:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.864218:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.864253:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.864259:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871ba00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707350.864263:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.864271:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.864288:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cfa19f4e700) 00010000:00010000:2.0:1787707350.864291:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787707350.864296:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.864302:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707350.864430:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+14:10577:x1874546707720064:12345-192.168.204.46@tcp:55:lhsmtool_posix.0 Request processed in 13914us (14147us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787707350.864453:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 126 00000100:00100000:1.0:1787707350.868685:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707350.868842:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707720320 00000100:00100000:0.0:1787707350.868852:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707720320 00000100:00100000:0.0:1787707350.868916:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 45 00000100:00100000:0.0:1787707350.868926:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2362:x1874546707720320:12345-192.168.204.46@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787707350.868970:0:8265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005367dc49/0xc5f18d5f94ec11d4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.868991:0:8265:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec11b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e4f expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.869000:0:8265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707350.869004:0:8265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787707350.869008:0:8265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005367dc49/0xc5f18d5f94ec11d4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.869042:0:8265:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec11b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e4f expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707350.869072:0:8265:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec11b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e4f expref: 7 pid: 6690 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707350.869087:0:8265:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8265:1874546729756160:192.168.204.46@tcp:104: 00000100:00100000:0.0:1787707350.869170:0:8265:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f5e240 going to sleep for 11 seconds 00000100:00100000:0.0:1787707350.873520:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707350.873705:0:8265:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8265:1874546729756160:192.168.204.46@tcp:104: 00010000:00010000:2.0:1787707350.873735:0:8265:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005367dc49/0xc5f18d5f94ec11d4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707350.874273:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707720448 00000100:00100000:1.0:1787707350.874282:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707720448 00010000:00010000:1.0:1787707350.874320:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec11b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e4f expref: 8 pid: 6690 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707350.874363:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 56 00000100:00100000:1.0:1787707350.874416:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2362:x1874546707720448:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787707350.874431:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707350.874458:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec11b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e4f expref: 8 pid: 6690 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.874858:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec11b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e4f expref: 8 pid: 6690 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.874884:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec11b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e4f expref: 8 pid: 6690 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.874914:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787707350.874919:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787707350.874924:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005367dc49/0xc5f18d5f94ec11d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.874935:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005367dc49/0xc5f18d5f94ec11d4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.874957:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707350.875018:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2362:x1874546707720448:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 645us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707350.875027:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 56 00010000:00010000:2.0:1787707350.875520:0:8265:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005367dc49/0xc5f18d5f94ec11d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.875548:0:8265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005367dc49/0xc5f18d5f94ec11d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.875590:0:8265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005367dc49/0xc5f18d5f94ec11d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.875599:0:8265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005367dc49/0xc5f18d5f94ec11d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.875607:0:8265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005367dc49/0xc5f18d5f94ec11d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.875615:0:8265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3a00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707350.875619:0:8265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005367dc49/0xc5f18d5f94ec11d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.875628:0:8265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005367dc49/0xc5f18d5f94ec11d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.875641:0:8265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005367dc49/0xc5f18d5f94ec11d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.875648:0:8265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005367dc49/0xc5f18d5f94ec11d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707350.875736:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2362:x1874546707720320:12345-192.168.204.46@tcp:1:lhsmtool_posix.0 Request processed in 6810us (7060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707350.875744:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 45 00000100:00100000:0.0:1787707350.884775:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707350.884940:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707720704 00000100:00100000:2.0:1787707350.884950:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707720704 00000100:00100000:2.0:1787707350.885037:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 127 00000100:00100000:2.0:1787707350.885049:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+14:10577:x1874546707720704:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787707350.885125:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.885143:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.885154:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.885545:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.885559:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec1195 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e3a expref: 15 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.885632:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11e2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.885669:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec1195 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e3a expref: 15 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.885701:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec1195 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e3a expref: 15 pid: 8469 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707350.885715:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874546729756288:192.168.204.46@tcp:104: 00000100:00100000:2.0:1787707350.885907:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa12a4f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787707350.892712:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707350.892825:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707720832 00000100:00100000:3.0:1787707350.892835:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707720832 00010000:00010000:3.0:1787707350.892943:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec1195 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e3a expref: 16 pid: 8469 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707350.892961:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874546729756288:192.168.204.46@tcp:104: 00010000:00010000:2.0:1787707350.892986:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707350.892994:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 57 00000100:00100000:3.0:1787707350.893007:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a591500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+16:2361:x1874546707720832:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787707350.893023:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707350.893031:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec1195 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e3a expref: 16 pid: 8469 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.893044:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec1195 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e3a expref: 16 pid: 8469 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.893078:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec1195 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e3a expref: 16 pid: 8469 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.893094:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cfa19f4e700) 00010000:00010000:3.0:1787707350.893099:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.893136:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.893143:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11e2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.893176:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787707350.893195:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.893204:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707350.893240:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a591500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+15:2361:x1874546707720832:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 235us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707350.893249:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 57 00000001:00080000:2.0:1787707350.893428:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1787707350.893618:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787707350.893663:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1787707350.893739:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874546729756416:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787707350.893782:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707350.893821:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41900cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707350.893936:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729756416 00000100:00100000:0.0:1787707350.893942:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729756416 00000100:00100000:0.0:1787707350.893986:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787707350.893994:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5858:x1874546729756416:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787707350.895134:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5858:x1874546729756416:12345-0@lo:1000:mdt00_002.0 Request processed in 1136us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707350.895145:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787707350.900885:0:5858:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787707350.900911:0:5858:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1787707350.900934:0:5858:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfa35b01c00, transno 4294967309 00000004:00080000:3.0:1787707350.900952:0:5858:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfa35b01880, transno 4294967310 00000100:00100000:3.0:1787707350.900963:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874546729756416:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787707350.903080:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1787707350.903166:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874546729756544:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787707350.903317:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707350.903362:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41900d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787707350.903455:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729756544 00000100:00100000:1.0:1787707350.903463:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729756544 00000100:00100000:1.0:1787707350.903530:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787707350.903540:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5858:x1874546729756544:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787707350.904033:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5858:x1874546729756544:12345-0@lo:1000:mdt00_002.0 Request processed in 493us (716us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787707350.904054:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787707350.905057:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874546729756544:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787707350.905110:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.905120:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11e2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.905127:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.905133:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707350.905138:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.905145:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11e2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.905161:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cfa19f4e700) 00010000:00010000:2.0:1787707350.905164:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787707350.905169:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11e2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.905176:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec11e2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.905204:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec1125 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.905211:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec1125 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.905217:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec1125 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.905245:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707350.905248:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec1125 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.905254:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec1125 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.905263:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:2.0:1787707350.905266:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787707350.905273:0:5858:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec112c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e1e expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.905285:0:5858:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec112c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e1e expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.905294:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec112c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e1e expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.905327:0:5858:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec112c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e1e expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707350.905342:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874546729756672:192.168.204.46@tcp:105: 00000100:00100000:2.0:1787707350.905446:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41900d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787707350.915997:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707350.916042:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707350.916082:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707350.916108:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707721216 00000100:00100000:0.0:1787707350.916117:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707721216 00000100:00100000:0.0:1787707350.916164:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 87 00000100:00100000:0.0:1787707350.916174:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2362:x1874546707721216:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707350.916254:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2362:x1874546707721216:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 81us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707350.916262:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 87 00000100:00100000:0.0:1787707350.916316:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707350.916408:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707721344 00000100:00100000:0.0:1787707350.916413:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707721344 00000100:00080000:0.0:1787707350.916434:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707350.916459:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 160 00000100:00100000:0.0:1787707350.916466:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2361:x1874546707721344:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707350.916512:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2361:x1874546707721344:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 46us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707350.916519:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 160 00000100:00100000:2.0:1787707350.916711:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874546729756672:192.168.204.46@tcp:105: 00010000:00010000:2.0:1787707350.916736:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec1125 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.916760:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec1125 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.916790:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec11e9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.916804:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec11e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.916816:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec11e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.916825:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec11e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.916830:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec11e9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.916837:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec11e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.916843:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871a800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707350.916847:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec11e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.916854:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec11e9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.916865:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:2.0:1787707350.916869:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707350.916872:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec11e9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.916884:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec11e9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.916906:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.916912:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.916918:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.916923:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871ba00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707350.916926:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.916931:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.916940:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:2.0:1787707350.916942:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787707350.916944:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11db lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707350.916949:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec11db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707350.917135:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+18:10577:x1874546707720704:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 Request processed in 32087us (32369us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1787707350.917143:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 127 00000020:00080000:2.0:1787707350.917153:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787707350.917456:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787707350.917460:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1787707350.919432:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707720960 00000100:00100000:3.0:1787707350.919447:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707720960 00000100:00100000:3.0:1787707350.919523:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 31 00000100:00100000:3.0:1787707350.919533:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+18:10576:x1874546707720960:12345-192.168.204.46@tcp:49:lfs.0 00000100:00100000:3.0:1787707350.919764:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+18:10576:x1874546707720960:12345-192.168.204.46@tcp:49:lfs.0 Request processed in 232us (3777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707350.919772:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 31 00000100:00100000:3.0:1787707350.919800:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707721088 00000100:00100000:3.0:1787707350.919804:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707721088 00000100:00100000:3.0:1787707350.919828:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 296 00000100:00100000:3.0:1787707350.919834:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07314450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:2361:x1874546707721088:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707350.919880:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07314450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:2361:x1874546707721088:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 46us (3838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707350.919886:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 296 00000040:00080000:0.0:1787707350.921313:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787707350.921329:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787707350.923970:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707350.924415:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707721600 00000100:00100000:3.0:1787707350.924424:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707721600 00000100:00100000:3.0:1787707350.924474:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 32 00000100:00100000:3.0:1787707350.924493:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa189fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+18:10577:x1874546707721600:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787707350.925177:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787707350.925290:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1787707350.925336:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec11f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.925351:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec11f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.925362:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec11f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.925401:0:5860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec11f0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.925408:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec11f0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.925415:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec11f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.925440:0:5860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787707350.925526:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa189fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+20:10577:x1874546707721600:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 Request processed in 1035us (1565us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1787707350.925545:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 32 00000020:00080000:3.0:1787707350.925550:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787707350.925860:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787707350.925868:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec11f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.925876:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd200 already unused, calling callback (ffffffffc1630230) 00010000:00010000:1.0:1787707350.925880:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec11f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.925887:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec11f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.925916:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cfa143e4e00) 00010000:00010000:1.0:1787707350.925919:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787707350.925924:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec11f0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.925930:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec11f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.925948:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707350.925950:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707350.925952:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707350.931803:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707350.931916:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707721856 00000100:00100000:3.0:1787707350.931926:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707721856 00000100:00100000:3.0:1787707350.931983:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 128 00000100:00100000:3.0:1787707350.931994:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+20:10576:x1874546707721856:12345-192.168.204.46@tcp:58:lfs.0 00000040:00080000:3.0:1787707350.932256:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787707350.932340:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+20:10576:x1874546707721856:12345-192.168.204.46@tcp:58:lfs.0 Request processed in 347us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707350.932348:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 128 00000100:00100000:0.0:1787707350.957682:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707350.957762:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707721984 00000100:00100000:3.0:1787707350.957772:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707721984 00000100:00100000:3.0:1787707350.957842:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 129 00000100:00100000:3.0:1787707350.957853:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+20:10579:x1874546707721984:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:3.0:1787707350.957877:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707350.957915:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec11f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e56 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.957982:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec11fe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.957998:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec11fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.958012:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec11fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.958027:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1205 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.958049:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.958057:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.958336:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec120c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.958347:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1117 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e17 expref: 21 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.958356:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec120c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.958413:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1117 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e17 expref: 21 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.958428:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1117 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e17 expref: 21 pid: 5858 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707350.958442:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c95500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874546729756800:192.168.204.46@tcp:104: 00000100:00100000:3.0:1787707350.958524:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05edb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787707350.963418:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707350.963557:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707722240 00000100:00100000:1.0:1787707350.963577:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707722240 00000100:00100000:1.0:1787707350.963683:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 33 00000100:00100000:1.0:1787707350.963694:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+22:6058:x1874546707722240:12345-192.168.204.46@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787707350.964501:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+23:6058:x1874546707722240:12345-192.168.204.46@tcp:35:ldlm_bl.0 Request processed in 807us (1134us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1787707350.964529:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 33 00000100:00100000:3.0:1787707350.968084:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c95500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874546729756800:192.168.204.46@tcp:104: 00010000:00010000:3.0:1787707350.968115:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec120c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707350.968364:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707350.969060:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707722368 00000100:00100000:0.0:1787707350.969070:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707722368 00010000:00010000:1.0:1787707350.969181:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1117 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e17 expref: 23 pid: 5858 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707350.969312:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 58 00000100:00100000:1.0:1787707350.969323:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a591880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+23:2362:x1874546707722368:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787707350.969339:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707350.969347:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1117 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e17 expref: 23 pid: 5858 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.969361:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1117 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e17 expref: 23 pid: 5858 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.969409:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1117 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e17 expref: 23 pid: 5858 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.969425:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:1.0:1787707350.969430:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec120c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.969440:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec120c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.969448:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec120c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707350.969477:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707350.969540:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a591880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+22:2362:x1874546707722368:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 219us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707350.969548:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 58 00010000:00010000:3.0:1787707350.971106:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec120c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.971131:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec120c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707350.971177:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787707350.971182:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787707350.971203:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec120c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.971217:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec120c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.971347:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec11fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.971355:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec11fe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.971362:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec11fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.971367:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fca00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707350.971501:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec11fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.971509:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec11fe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.971523:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:3.0:1787707350.971526:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707350.971530:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec11fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.971548:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec11fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.971635:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.971643:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1205 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.971649:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1205 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.971748:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707350.971752:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1205 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.971758:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1205 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.971766:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cfa143e4600) 00010000:00010000:3.0:1787707350.971833:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707350.971837:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1205 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.971843:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1205 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.971885:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec11f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e56 expref: 22 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.971990:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec120c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e56 expref: 21 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707350.973212:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:3.0:1787707350.973219:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787707350.973224:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fd200, rc 0) 00000100:00100000:0.0:1787707350.973668:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+21:10579:x1874546707721984:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 15812us (15991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707350.973677:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 129 00010000:00010000:3.0:1787707351.288735:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787707351.689251:0:12060:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787707351.689261:0:12060:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787707351.689306:0:12060:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787707351.689313:0:12060:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787707351.932092:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787707351.932102:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787707351.932138:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787707351.932145:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787707351.932262:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b02300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874546729756928:192.168.204.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787707351.932357:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa12a4f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787707351.956520:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707351.956559:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707722496 00000100:00100000:1.0:1787707351.956567:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707722496 00000100:00100000:1.0:1787707351.956634:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 130 00000100:00100000:1.0:1787707351.956646:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+22:10591:x1874546707722496:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787707351.956704:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787707351.956805:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+22:10591:x1874546707722496:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 Request processed in 162us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707351.956813:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 130 00000100:00080000:1.0:1787707351.956834:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707351.961100:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b02300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874546729756928:192.168.204.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787707351.971287:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707351.971353:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707722752 00000100:00100000:0.0:1787707351.971364:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707722752 00000100:00100000:0.0:1787707351.971447:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 131 00000100:00100000:0.0:1787707351.971458:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+21:10591:x1874546707722752:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787707351.971479:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707351.971514:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1213 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e5d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707351.971787:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec121a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707351.971802:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec121a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707351.971815:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec121a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707351.971828:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787707351.972031:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1213 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e5d expref: 24 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707351.972048:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec121a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e5d expref: 23 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707351.972056:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:0.0:1787707351.972058:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787707351.972061:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2000, rc 0) 00000100:00100000:0.0:1787707351.972124:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+23:10591:x1874546707722752:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 667us (846us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1787707351.972131:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 131 00000100:00100000:0.0:1787707351.977123:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707351.977198:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707723008 00000100:00100000:1.0:1787707351.977207:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707723008 00000100:00100000:1.0:1787707351.977276:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 132 00000100:00100000:1.0:1787707351.977287:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+23:10591:x1874546707723008:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787707351.977365:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14000/0xc5f18d5f94ec1228 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707351.977415:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14000/0xc5f18d5f94ec1228 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707351.977427:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14000/0xc5f18d5f94ec1228 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707351.977937:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14000/0xc5f18d5f94ec1228 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707351.977961:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14000/0xc5f18d5f94ec1228 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707351.977967:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14000/0xc5f18d5f94ec1228 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707351.977973:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707351.977978:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14000/0xc5f18d5f94ec1228 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707351.977986:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14000/0xc5f18d5f94ec1228 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707351.977999:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:1.0:1787707351.978002:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787707351.978007:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14000/0xc5f18d5f94ec1228 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707351.978014:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14000/0xc5f18d5f94ec1228 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707351.978167:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+24:10591:x1874546707723008:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 Request processed in 880us (1051us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787707351.978175:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 132 00000100:00100000:2.0:1787707351.978678:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707351.978761:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707723136 00000100:00100000:2.0:1787707351.978768:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707723136 00000100:00100000:2.0:1787707351.978811:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 9 00000100:00100000:2.0:1787707351.978821:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+24:2360:x1874546707723136:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787707351.978835:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707351.978855:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec121a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e5d expref: 24 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707351.978880:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:2.0:1787707351.978885:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707351.978916:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+23:2360:x1874546707723136:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 97us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707351.978923:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 9 00000040:00080000:0.0:1787707351.979450:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787707351.979455:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787707351.979948:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787707351.979956:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787707351.980956:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707351.981140:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707723392 00000100:00100000:3.0:1787707351.981149:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707723392 00000100:00100000:3.0:1787707351.981198:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 34 00000100:00100000:3.0:1787707351.981208:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+23:10591:x1874546707723392:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787707351.981975:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+24:10591:x1874546707723392:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 Request processed in 765us (1021us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787707351.981985:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 34 00010000:00010000:0.0:1787707352.316055:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707352.378256:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787707352.378285:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729757056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787707352.378362:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707352.378544:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729757056 00000100:00100000:0.0:1787707352.378554:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729757056 00000100:00100000:0.0:1787707352.378627:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787707352.378637:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1874546729757056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787707352.378670:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707352.378717:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1874546729757056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707352.378724:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787707352.378769:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729757056:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787707352.378882:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787707353.338924:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787707353.396981:0:12111:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787707353.396993:0:12111:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787707353.397042:0:12111:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787707353.397047:0:12111:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787707353.633562:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707353.633665:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707723648 00000100:00100000:0.0:1787707353.633676:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707723648 00000100:00100000:0.0:1787707353.633766:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 133 00000100:00100000:0.0:1787707353.633777:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+24:10612:x1874546707723648:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:0.0:1787707353.633803:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707353.633826:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec122f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e64 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707353.633952:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1236 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707353.633966:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1236 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707353.633977:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1236 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707353.633988:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787707353.634110:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec122f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e64 expref: 27 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707353.634255:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1236 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e64 expref: 26 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707353.634264:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:0.0:1787707353.634267:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787707353.634270:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2200, rc 0) 00000100:00080000:2.0:1787707353.634399:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707353.634770:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+26:10612:x1874546707723648:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 994us (1216us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1787707353.634778:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 133 00000100:00100000:2.0:1787707353.641806:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707353.642756:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707723776 00000100:00100000:1.0:1787707353.642770:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707723776 00000100:00100000:1.0:1787707353.642865:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 134 00000100:00100000:1.0:1787707353.642876:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+26:10612:x1874546707723776:12345-192.168.204.46@tcp:54:lfs.0 00010000:00010000:1.0:1787707353.642969:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec1244 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707353.642988:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec1244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707353.642999:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec1244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707353.643026:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec1244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707353.643033:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec1244 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707353.643040:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec1244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707353.643047:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14c00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707353.643051:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec1244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707353.643058:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec1244 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707353.643069:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:1.0:1787707353.643072:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787707353.643076:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec1244 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707353.643092:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec1244 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707353.643196:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+26:10612:x1874546707723776:12345-192.168.204.46@tcp:54:lfs.0 Request processed in 322us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707353.643204:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 134 00000100:00100000:0.0:1787707353.769197:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707353.769296:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707723904 00000100:00100000:3.0:1787707353.769307:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707723904 00000100:00100000:3.0:1787707353.769435:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 46 00000100:00100000:3.0:1787707353.769447:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2360:x1874546707723904:12345-192.168.204.46@tcp:101:cat.0 00010000:00010000:3.0:1787707353.769467:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707353.769490:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec124b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e6b expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787707353.769519:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8e3fd5, atime: 0x6a8e3fd4, ctime: 0x6a8e3fd5, blocks: 0xb 00010000:00010000:3.0:1787707353.769543:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1787707353.769548:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707353.769574:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec124b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e6b expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707353.769597:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec124b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e6b expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707353.769612:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fc800, rc 0) 00000100:00100000:3.0:1787707353.770088:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2360:x1874546707723904:12345-192.168.204.46@tcp:101:cat.0 Request processed in 641us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707353.770096:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 46 00000100:00080000:2.0:1787707353.770618:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787707353.774176:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707353.779815:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707724032 00000100:00100000:1.0:1787707353.779831:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707724032 00002000:00100000:1.0:1787707353.780101:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8cfa0871d180 x1874546707724032/t0(0) o3->9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp:244/0 lens 488/0 e 0 to 0 dl 1787707364 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787707353.780113:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa0871d180 with x1874546707724032 ext(0->4095) 00002000:00010000:1.0:1787707353.780507:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfa0871d180 00000100:00100000:1.0:1787707353.780552:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 3 00000100:00100000:1.0:1787707353.780564:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2359:x1874546707724032:12345-192.168.204.46@tcp:3:cat.0 00000100:00100000:1.0:1787707353.782230:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2359:x1874546707724032:12345-192.168.204.46@tcp:3:cat.0 Request processed in 1660us (8059us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787707353.782242:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 3 00002000:00100000:1.0:1787707353.782253:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8cfa0871d180 x1874546707724032/t0(0) o3->9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp:244/0 lens 488/4536 e 0 to 0 dl 1787707364 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787707353.782264:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa0871d180 with x1874546707724032 ext(0->4095) 00002000:00010000:1.0:1787707353.782269:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfa0871d180 00010000:00010000:3.0:1787707354.361737:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707354.426807:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa059b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729757312:0@lo:400:kworker.0 00000100:00100000:0.0:1787707354.426896:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707354.426960:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa059b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729757824:0@lo:400:kworker.0 00000100:00100000:0.0:1787707354.426990:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707354.427021:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787707354.427027:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa059b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729757184:0@lo:400:kworker.0 00000100:00100000:0.0:1787707354.427064:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707354.427087:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa059b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729757696:0@lo:400:kworker.0 00000100:00100000:0.0:1787707354.427111:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707354.427139:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa059b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729757440:0@lo:400:kworker.0 00000100:00100000:0.0:1787707354.427165:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707354.427182:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787707354.427187:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa059b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729757568:0@lo:400:kworker.0 00000100:00100000:0.0:1787707354.427207:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707354.427257:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729757184 00000100:00100000:0.0:1787707354.427265:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729757184 00000100:00100000:0.0:1787707354.427311:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787707354.427321:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07316850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729757184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707354.427397:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07316850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729757184:12345-0@lo:400:kworker.0 Request processed in 77us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707354.427405:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787707354.427440:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729757824 00000100:00100000:0.0:1787707354.427445:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729757824 00000100:00100000:0.0:1787707354.427478:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729757568 00000100:00100000:0.0:1787707354.427481:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729757568 00000100:00100000:0.0:1787707354.427516:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787707354.427523:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1874546729757824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707354.427556:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1874546729757824:12345-0@lo:400:kworker.0 Request processed in 33us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707354.427562:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787707354.427574:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787707354.427580:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1874546729757568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707354.427611:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1874546729757568:12345-0@lo:400:kworker.0 Request processed in 32us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707354.427617:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787707354.427654:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa059b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729757568:0@lo:400:kworker.0 00000100:00100000:0.0:1787707354.427683:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa059b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729757184:0@lo:400:kworker.0 00000100:00100000:0.0:1787707354.427694:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa059b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729757824:0@lo:400:kworker.0 00000100:00100000:0.0:1787707354.427715:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729757312 00000100:00100000:0.0:1787707354.427718:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729757312 00000100:00100000:0.0:1787707354.427750:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729757696 00000100:00100000:0.0:1787707354.427753:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729757696 00000100:00100000:0.0:1787707354.427766:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729757440 00000100:00100000:0.0:1787707354.427768:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729757440 00000100:00100000:0.0:1787707354.427783:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787707354.427790:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729757312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707354.427843:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729757312:12345-0@lo:400:kworker.0 Request processed in 53us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707354.427849:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787707354.427861:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787707354.427868:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729757696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707354.427894:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729757696:12345-0@lo:400:kworker.0 Request processed in 27us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707354.427900:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787707354.427910:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787707354.427916:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729757440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707354.427946:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729757440:12345-0@lo:400:kworker.0 Request processed in 30us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707354.427951:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787707354.427978:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa059b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729757440:0@lo:400:kworker.0 00000100:00100000:0.0:1787707354.428000:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa059b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729757696:0@lo:400:kworker.0 00000100:00100000:0.0:1787707354.428010:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa059b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729757312:0@lo:400:kworker.0 00000100:00080000:2.0:1787707354.428288:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787707354.428295:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787707354.428297:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787707354.508683:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1787707354.508716:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1787707354.508723:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1787707354.937795:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729757952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787707354.937880:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707354.937962:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729757952 00000100:00100000:0.0:1787707354.937978:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729757952 00000100:00100000:0.0:1787707354.938027:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787707354.938036:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729757952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787707354.938070:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707354.938114:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729757952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707354.938122:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787707354.938159:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1787707354.938164:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1787707354.938338:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfa2f4a5880, transno 4294967304 00000100:00100000:0.0:1787707354.938364:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729757952:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787707355.391763:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707356.041885:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707356.041930:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707356.041962:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707356.041983:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707356.042007:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707356.042050:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707724672 00000100:00100000:0.0:1787707356.042059:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707724672 00000100:00100000:0.0:1787707356.042121:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707724288 00000100:00100000:0.0:1787707356.042123:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707724288 00000100:00100000:0.0:1787707356.042147:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 164 00000100:00100000:0.0:1787707356.042157:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2361:x1874546707724672:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707356.042240:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2361:x1874546707724672:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 84us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707356.042248:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 164 00000100:00100000:0.0:1787707356.042267:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 165 00000100:00100000:0.0:1787707356.042287:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+26:2361:x1874546707724288:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707356.042315:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+26:2361:x1874546707724288:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 29us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707356.042322:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 165 00000100:00100000:0.0:1787707356.042406:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707724416 00000100:00100000:0.0:1787707356.042410:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707724416 00000100:00100000:0.0:1787707356.042686:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707724544 00000100:00100000:0.0:1787707356.042690:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707724544 00000100:00100000:0.0:1787707356.042712:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 90 00000100:00100000:0.0:1787707356.042719:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2361:x1874546707724416:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707356.042750:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2361:x1874546707724416:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 32us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707356.042756:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 90 00000100:00100000:0.0:1787707356.042768:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 91 00000100:00100000:0.0:1787707356.042774:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2361:x1874546707724544:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707356.042809:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2361:x1874546707724544:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 35us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707356.042815:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 91 00000100:00100000:3.0:1787707356.043242:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707724160 00000100:00100000:3.0:1787707356.043249:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707724160 00000100:00100000:3.0:1787707356.043291:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 298 00000100:00100000:3.0:1787707356.043298:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07314050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:2361:x1874546707724160:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707356.043329:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07314050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:2361:x1874546707724160:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 32us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707356.043335:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 298 00000100:00080000:3.0:1787707356.043738:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787707356.043744:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787707356.043747:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1787707356.058366:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1787707356.058407:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1787707356.058423:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:0.0:1787707356.058434:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:0.0:1787707356.058468:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cfa3cbd59c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787707356.058473:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfa1fb77f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cfa3cbd5600 00000020:00080000:0.0:1787707356.058477:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfa1fb77b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cfa2f21a000 00000020:00080000:0.0:1787707356.058515:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1787707356.058718:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000040:00080000:2.0:1787707356.090535:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787707356.090552:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787707356.090870:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787707356.090878:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1787707356.102734:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1787707356.102974:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:3.0:1787707356.412160:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707357.432624:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707357.502463:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787707357.502487:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729758080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787707357.502572:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707357.502637:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729758080 00000100:00100000:3.0:1787707357.502646:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729758080 00000100:00100000:3.0:1787707357.502706:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787707357.502715:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729758080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787707357.502754:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707357.502810:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729758080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707357.502818:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787707357.502838:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787707357.502863:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1787707357.502870:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1787707357.502897:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729758080:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787707358.457527:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707359.356790:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707359.364709:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707724800 00000100:00100000:2.0:1787707359.364740:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707724800 00000100:00100000:2.0:1787707359.364833:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 135 00000100:00100000:2.0:1787707359.364848:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+13:10264:x1874546707724800:12345-192.168.204.46@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787707359.364977:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+13:10264:x1874546707724800:12345-192.168.204.46@tcp:60:lhsmtool_posix.0 Request processed in 134us (8199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707359.364984:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 135 00000100:00080000:3.0:1787707359.365284:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707359.376093:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707359.376422:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707725056 00000100:00100000:2.0:1787707359.376434:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707725056 00000100:00100000:2.0:1787707359.376506:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 35 00000100:00100000:2.0:1787707359.376517:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+13:10264:x1874546707725056:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787707359.377826:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+14:10264:x1874546707725056:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 Request processed in 1304us (1736us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1787707359.377838:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 35 00010000:00010000:3.0:1787707359.482516:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707359.545626:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729758592:0@lo:400:kworker.0 00000100:00100000:2.0:1787707359.545736:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707359.545801:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787707359.545808:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729758464:0@lo:400:kworker.0 00000100:00100000:2.0:1787707359.545834:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707359.545868:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729758464 00000100:00100000:2.0:1787707359.545876:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729758464 00000100:00100000:2.0:1787707359.545930:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787707359.545940:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f68a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729758464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707359.545993:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f68a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729758464:12345-0@lo:400:kworker.0 Request processed in 55us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707359.546001:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:2.0:1787707359.546023:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787707359.546053:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729758464:0@lo:400:kworker.0 00000100:00100000:3.0:1787707359.546141:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729758592 00000100:00100000:3.0:1787707359.546146:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729758592 00000100:00100000:3.0:1787707359.546188:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787707359.546196:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f68b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729758592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707359.546237:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f68b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729758592:12345-0@lo:400:kworker.0 Request processed in 42us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707359.546242:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787707359.546858:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f68b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729758336:0@lo:400:kworker.0 00000100:00100000:0.0:1787707359.546905:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707359.546938:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729758848:0@lo:400:kworker.0 00000100:00100000:0.0:1787707359.546962:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707359.546992:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787707359.546999:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729758208:0@lo:400:kworker.0 00000100:00100000:0.0:1787707359.547025:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707359.547048:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f68a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729758720:0@lo:400:kworker.0 00000100:00100000:0.0:1787707359.547072:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707359.547097:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729758848 00000100:00100000:0.0:1787707359.547103:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729758848 00000100:00100000:0.0:1787707359.547136:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787707359.547144:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729758848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707359.547181:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729758848:12345-0@lo:400:kworker.0 Request processed in 38us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707359.547187:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787707359.547209:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729758208 00000100:00100000:0.0:1787707359.547214:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729758208 00000100:00100000:0.0:1787707359.547238:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1787707359.547245:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07316050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729758208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707359.547299:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07316050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729758208:12345-0@lo:400:kworker.0 Request processed in 54us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707359.547305:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1787707359.547339:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729758336 00000100:00100000:0.0:1787707359.547343:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729758336 00000100:00100000:0.0:1787707359.547362:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729758720 00000100:00100000:0.0:1787707359.547365:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729758720 00000100:00100000:0.0:1787707359.547405:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787707359.547411:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729758336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707359.547437:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729758336:12345-0@lo:400:kworker.0 Request processed in 27us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707359.547443:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787707359.547452:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787707359.547457:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729758720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707359.547476:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729758720:12345-0@lo:400:kworker.0 Request processed in 19us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707359.547481:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787707359.547510:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729758208:0@lo:400:kworker.0 00000100:00100000:0.0:1787707359.547520:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f68a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729758720:0@lo:400:kworker.0 00000100:00100000:0.0:1787707359.547528:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f68b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729758336:0@lo:400:kworker.0 00000100:00100000:0.0:1787707359.547535:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729758848:0@lo:400:kworker.0 00000100:00080000:2.0:1787707359.549919:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787707359.549932:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787707359.549935:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787707359.549996:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729758592:0@lo:400:kworker.0 00000100:00100000:1.0:1787707359.813351:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707359.813552:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707725184 00000100:00100000:0.0:1787707359.813563:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707725184 00000100:00100000:0.0:1787707359.813650:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 136 00000100:00100000:0.0:1787707359.813662:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:11064:x1874546707725184:12345-192.168.204.46@tcp:101:lsof.0 00010000:00010000:0.0:1787707359.813699:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707359.813734:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1252 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e72 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707359.813921:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1259 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707359.813936:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1259 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707359.813947:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1259 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707359.814222:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787707359.814226:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787707359.814334:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1259 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707359.814362:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1252 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e72 expref: 7 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707359.814412:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1259 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e72 expref: 6 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707359.814421:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa06897700) 00010000:00010000:0.0:1787707359.814424:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787707359.814509:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2000, rc 0) 00000100:00080000:2.0:1787707359.814670:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707359.814792:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+6:11064:x1874546707725184:12345-192.168.204.46@tcp:101:lsof.0 Request processed in 1130us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707359.814799:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 136 00000100:00100000:2.0:1787707360.057072:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787707360.057097:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729758976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787707360.057168:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707360.057337:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729758976 00000100:00100000:3.0:1787707360.057347:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729758976 00000100:00100000:3.0:1787707360.057420:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787707360.057431:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729758976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787707360.057506:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707360.057568:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729758976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707360.057575:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787707360.057787:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729758976:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787707360.505178:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707361.157354:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707361.157436:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707361.157485:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707361.157522:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707361.157547:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707361.157575:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707725696 00000100:00100000:0.0:1787707361.157584:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707725696 00000100:00100000:0.0:1787707361.157638:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707725568 00000100:00100000:0.0:1787707361.157640:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707725568 00000100:00100000:0.0:1787707361.157660:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 94 00000100:00100000:0.0:1787707361.157670:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2361:x1874546707725696:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707361.157747:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2361:x1874546707725696:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 79us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707361.157755:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 94 00000100:00100000:0.0:1787707361.157773:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 95 00000100:00100000:0.0:1787707361.157780:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2361:x1874546707725568:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707361.157820:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2361:x1874546707725568:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 40us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707361.157826:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 95 00000100:00100000:0.0:1787707361.157845:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707725312 00000100:00100000:0.0:1787707361.157849:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707725312 00000100:00100000:0.0:1787707361.157870:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 300 00000100:00100000:0.0:1787707361.157877:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+13:2361:x1874546707725312:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707361.157902:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+13:2361:x1874546707725312:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 27us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707361.157919:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 300 00000100:00080000:0.0:1787707361.158059:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787707361.158063:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787707361.158071:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707725440 00000100:00100000:0.0:1787707361.158075:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707725440 00000100:00100000:0.0:1787707361.158105:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707725824 00000100:00100000:0.0:1787707361.158108:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707725824 00000100:00100000:0.0:1787707361.158129:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 169 00000100:00100000:0.0:1787707361.158135:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+14:2361:x1874546707725440:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707361.158173:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+14:2361:x1874546707725440:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 38us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707361.158179:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 169 00000100:00100000:0.0:1787707361.158191:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 170 00000100:00100000:0.0:1787707361.158196:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+6:2361:x1874546707725824:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707361.158218:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+6:2361:x1874546707725824:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 22us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707361.158223:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 170 00000100:00080000:0.0:1787707361.158263:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00080000:1.0:1787707361.213080:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1787707361.213120:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1787707361.213446:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787707361.213457:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1787707361.528970:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707362.553300:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707362.618482:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787707362.618509:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729759104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787707362.618586:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707362.621147:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729759104 00000100:00100000:3.0:1787707362.621167:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729759104 00000100:00100000:3.0:1787707362.621276:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787707362.621287:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729759104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787707362.621327:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707362.621446:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729759104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (2859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707362.621453:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1787707362.621849:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787707362.622459:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729759104:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787707363.580426:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787707363.588895:0:12313:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 21:22:40 (1787707360) 00010000:00010000:0.0:1787707364.600950:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707364.669385:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729759488:0@lo:400:kworker.0 00000100:00100000:1.0:1787707364.669485:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707364.669567:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787707364.669573:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729759616:0@lo:400:kworker.0 00000100:00100000:1.0:1787707364.669600:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707364.669729:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729759232:0@lo:400:kworker.0 00000100:00100000:3.0:1787707364.669767:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707364.669807:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729759744:0@lo:400:kworker.0 00000100:00100000:3.0:1787707364.669831:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707364.669849:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787707364.669855:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729759360:0@lo:400:kworker.0 00000100:00100000:3.0:1787707364.669876:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707364.669891:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729759872:0@lo:400:kworker.0 00000100:00100000:3.0:1787707364.669910:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707364.670002:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729759488 00000100:00100000:0.0:1787707364.670010:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729759488 00000100:00100000:0.0:1787707364.670070:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729759744 00000100:00100000:0.0:1787707364.670073:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729759744 00000100:00100000:0.0:1787707364.670099:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729759360 00000100:00100000:0.0:1787707364.670102:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729759360 00000100:00100000:0.0:1787707364.670118:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787707364.670126:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729759488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707364.670192:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729759488:12345-0@lo:400:kworker.0 Request processed in 67us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707364.670200:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787707364.670221:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787707364.670240:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729759744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707364.670277:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729759744:12345-0@lo:400:kworker.0 Request processed in 50us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707364.670283:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787707364.670295:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787707364.670300:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729759360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707364.670325:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729759360:12345-0@lo:400:kworker.0 Request processed in 25us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707364.670331:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787707364.670349:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729759616 00000100:00100000:0.0:1787707364.670353:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729759616 00000100:00100000:0.0:1787707364.670414:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729759872 00000100:00100000:0.0:1787707364.670417:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729759872 00000100:00100000:0.0:1787707364.670436:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787707364.670448:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729759616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707364.670484:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729759616:12345-0@lo:400:kworker.0 Request processed in 40us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707364.670501:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787707364.670515:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787707364.670522:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729759872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707364.670556:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729759872:12345-0@lo:400:kworker.0 Request processed in 36us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707364.670562:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787707364.670593:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729759360:0@lo:400:kworker.0 00000100:00100000:2.0:1787707364.670621:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729759872:0@lo:400:kworker.0 00000100:00100000:2.0:1787707364.670648:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729759744:0@lo:400:kworker.0 00000100:00080000:3.0:1787707364.671736:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787707364.671744:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787707364.671747:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787707364.672759:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729759232 00000100:00100000:1.0:1787707364.672772:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729759232 00000100:00100000:1.0:1787707364.672835:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787707364.672846:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729759232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707364.672941:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729759232:12345-0@lo:400:kworker.0 Request processed in 89us (3165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707364.672948:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787707364.673012:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729759616:0@lo:400:kworker.0 00000100:00100000:1.0:1787707364.673027:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729759488:0@lo:400:kworker.0 00000100:00100000:3.0:1787707364.673253:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729759232:0@lo:400:kworker.0 00000100:00100000:2.0:1787707365.176887:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787707365.186920:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729760000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787707365.187010:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707365.187467:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729760000 00000100:00100000:3.0:1787707365.187477:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729760000 00000100:00100000:3.0:1787707365.187538:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787707365.187549:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729760000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787707365.187590:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707365.187664:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729760000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707365.187672:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787707365.188913:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729760000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787707365.398199:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707365.398438:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707726080 00000100:00100000:1.0:1787707365.398451:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707726080 00000100:00100000:1.0:1787707365.398553:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 137 00000100:00100000:1.0:1787707365.398569:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+13:11329:x1874546707726080:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787707365.398593:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707365.398627:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec1260 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e79 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.398845:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec1267 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.398861:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec1267 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.398894:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec1267 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.398908:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec126e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.398915:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec126e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.398921:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec126e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787707365.399429:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787707365.401574:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec1275 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.401599:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec1275 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.401613:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec1275 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707365.401642:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787707365.401869:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec1267 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.401877:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec1267 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.401884:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec1267 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.401892:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14e00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707365.401905:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec1267 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.401913:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec1267 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.401928:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cfa12a49100) 00010000:00010000:1.0:1787707365.401931:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707365.401937:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec1267 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.401944:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec1267 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.401959:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec126e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.401966:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec126e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.401972:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec126e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.401977:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14a00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707365.401980:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec126e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.401985:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec126e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.401992:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cfa204c6500) 00010000:00010000:1.0:1787707365.401995:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707365.402004:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec126e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.402010:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec126e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.402477:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec1260 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e79 expref: 16 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.402495:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec1275 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e79 expref: 15 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.402502:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfa06897a00) 00010000:00010000:1.0:1787707365.402504:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707365.402506:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a15000, rc 0) 00000100:00100000:1.0:1787707365.402612:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+15:11329:x1874546707726080:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 4045us (4421us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787707365.402637:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 137 00000100:00100000:0.0:1787707365.414881:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707365.416035:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707726208 00000100:00100000:2.0:1787707365.416051:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707726208 00000100:00100000:2.0:1787707365.416147:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 138 00000100:00100000:2.0:1787707365.416161:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+15:11329:x1874546707726208:12345-192.168.204.46@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787707365.416317:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+15:11329:x1874546707726208:12345-192.168.204.46@tcp:59:lhsmtool_posix.0 Request processed in 159us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707365.416325:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 138 00000100:00100000:2.0:1787707365.426033:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707365.426145:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707726336 00000100:00100000:1.0:1787707365.426157:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707726336 00000100:00100000:1.0:1787707365.426239:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 10 00000100:00100000:1.0:1787707365.426251:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa113ce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+15:2361:x1874546707726336:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787707365.426268:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707365.426297:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec1275 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e79 expref: 15 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707365.426316:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfa06897a00) 00010000:00010000:1.0:1787707365.426784:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707365.426919:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa113ce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+14:2361:x1874546707726336:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 668us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707365.426929:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 10 00010000:00010000:1.0:1787707365.626482:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787707366.252637:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:0.0:1787707366.276156:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707366.276192:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707366.276214:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707366.276236:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707366.276260:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707366.276290:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707726464 00000100:00100000:0.0:1787707366.276299:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707726464 00000100:00100000:0.0:1787707366.276346:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 302 00000100:00100000:0.0:1787707366.276357:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07314850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:2360:x1874546707726464:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707366.276443:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07314850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:2360:x1874546707726464:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 86us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707366.276450:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 302 00000100:00100000:0.0:1787707366.276497:0:12022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707726720 00000100:00100000:0.0:1787707366.276501:0:12022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707726720 00000100:00100000:0.0:1787707366.276534:0:12022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707726848 00000100:00100000:0.0:1787707366.276537:0:12022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707726848 00000100:00100000:0.0:1787707366.276558:0:12022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 98 00000100:00100000:0.0:1787707366.276565:0:12022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2360:x1874546707726720:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707366.276594:0:12022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2360:x1874546707726720:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 29us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707366.276623:0:12022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 98 00000100:00100000:0.0:1787707366.276636:0:12022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 99 00000100:00100000:0.0:1787707366.276643:0:12022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2360:x1874546707726848:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707366.276685:0:12022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2360:x1874546707726848:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 42us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707366.276691:0:12022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 99 00000100:00100000:0.0:1787707366.276719:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707726976 00000100:00100000:0.0:1787707366.276723:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707726976 00000100:00100000:0.0:1787707366.276750:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707726592 00000100:00100000:0.0:1787707366.276754:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707726592 00000100:00100000:0.0:1787707366.276772:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 174 00000100:00100000:0.0:1787707366.276778:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+6:2360:x1874546707726976:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707366.276810:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+6:2360:x1874546707726976:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 32us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707366.276815:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 174 00000100:00100000:0.0:1787707366.276827:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 175 00000100:00100000:0.0:1787707366.276834:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+13:2360:x1874546707726592:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707366.276858:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+13:2360:x1874546707726592:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 25us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707366.276865:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 175 00000100:00080000:0.0:1787707366.277013:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787707366.277018:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787707366.277020:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1787707366.335818:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787707366.335827:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787707366.336695:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1787707366.336704:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787707366.653240:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707367.542939:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707367.545311:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707727104 00000100:00100000:1.0:1787707367.545334:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707727104 00000100:00080000:0.0:1787707367.545413:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787707367.545457:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 139 00000100:00100000:1.0:1787707367.545472:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+13:11371:x1874546707727104:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:1.0:1787707367.545497:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707367.545535:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec1283 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e80 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.545621:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec128a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.545637:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec128a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.545652:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec128a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.545668:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1291 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.545676:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1291 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.545683:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1291 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.545997:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec128a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.546007:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec128a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.546014:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec128a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.546020:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14e00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707367.546024:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec128a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.546032:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec128a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.546046:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa06897700) 00010000:00010000:1.0:1787707367.546050:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707367.546054:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec128a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.546060:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec128a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.546073:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1291 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.546079:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1291 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.546085:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1291 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.546097:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14a00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707367.546100:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1291 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.546107:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1291 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.546116:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cfa204c6500) 00010000:00010000:1.0:1787707367.546119:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707367.546121:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1291 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.546127:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1291 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.546161:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec1283 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e80 expref: 14 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.546173:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa06897700) 00010000:00010000:1.0:1787707367.546175:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707367.546179:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec1283 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e80 expref: 14 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.546189:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a14800, rc 0) 00000100:00100000:1.0:1787707367.546717:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+13:11371:x1874546707727104:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 1243us (3786us total) trans 0 rc 301/301 00000100:00100000:1.0:1787707367.546728:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 139 00000100:00100000:0.0:1787707367.563426:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707367.564852:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707727360 00000100:00100000:2.0:1787707367.564866:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707727360 00000100:00100000:2.0:1787707367.564942:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 140 00000100:00100000:2.0:1787707367.564953:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+13:11371:x1874546707727360:12345-192.168.204.46@tcp:36:lfs.0 00010000:00010000:2.0:1787707367.565010:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707367.565039:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5600/0xc5f18d5f94ec0c01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cb9 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.565064:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa06897700) 00010000:00010000:2.0:1787707367.565084:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787707367.565460:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1298 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.566115:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1259 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e72 expref: 5 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.566127:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1298 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.566168:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1259 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e72 expref: 5 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.566186:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1259 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e72 expref: 5 pid: 8469 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707367.566203:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f68ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874546729760128:192.168.204.46@tcp:104: 00000100:00100000:3.0:1787707367.567934:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707367.574642:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707367.574771:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707727488 00000100:00100000:2.0:1787707367.574782:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707727488 00010000:00010000:2.0:1787707367.574828:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1259 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e72 expref: 6 pid: 8469 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707367.574875:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 59 00000100:00100000:2.0:1787707367.574885:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+6:2361:x1874546707727488:12345-192.168.204.46@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787707367.574890:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f68ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874546729760128:192.168.204.46@tcp:104: 00010000:00010000:2.0:1787707367.574902:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707367.574909:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1259 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e72 expref: 6 pid: 8469 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707367.574929:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1298 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.574945:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1259 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e72 expref: 6 pid: 8469 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.574970:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1259 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e72 expref: 6 pid: 8469 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.574986:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa06897700) 00010000:00010000:2.0:1787707367.574991:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1298 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.575000:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1298 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.575006:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1298 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.575032:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787707367.575078:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1298 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707367.575086:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1298 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707367.575087:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2361:x1874546707727488:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 203us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707367.575095:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 59 00010000:00010000:3.0:1787707367.575109:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec129f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707367.575129:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec129f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707367.575138:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec129f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707367.576404:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787707367.576418:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1298 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707367.576427:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1298 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707367.576434:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1298 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707367.576440:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871be00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707367.576444:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1298 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707367.576451:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1298 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707367.576467:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa06897700) 00010000:00010000:3.0:1787707367.576470:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707367.576475:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1298 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707367.576480:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1298 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787707367.576509:0:8469:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008dc920d9 reply state 0000000069e4f5d3 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec129f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707367.576517:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787707367.576606:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+14:11371:x1874546707727360:12345-192.168.204.46@tcp:36:lfs.0 Request processed in 11652us (13190us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1787707367.576614:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 140 00010000:00010000:2.0:1787707367.581752:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec129f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.581773:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec129f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.581781:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec129f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.581809:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707367.581814:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec129f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.581821:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec129f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.581842:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cfa143e4900) 00010000:00010000:2.0:1787707367.581846:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707367.581850:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec129f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.581857:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec129f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707367.673743:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707367.699696:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707367.700414:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707727616 00000100:00100000:2.0:1787707367.700427:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707727616 00000100:00100000:2.0:1787707367.700506:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 141 00000100:00100000:2.0:1787707367.700518:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+13:11379:x1874546707727616:12345-192.168.204.46@tcp:101:lctl.0 00010000:00010000:2.0:1787707367.700543:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707367.700569:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec12a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e87 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.700649:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec12ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.700802:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec12ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.700835:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec12ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707367.700913:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787707367.700917:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787707367.700949:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec12ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.700978:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec12a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e87 expref: 15 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.700998:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec12ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e87 expref: 14 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.701007:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:2.0:1787707367.701010:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787707367.701013:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871b200, rc 0) 00000100:00100000:2.0:1787707367.701087:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+14:11379:x1874546707727616:12345-192.168.204.46@tcp:101:lctl.0 Request processed in 571us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707367.701095:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 141 00000100:00100000:2.0:1787707367.737023:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729760256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787707367.737092:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707367.737222:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729760256 00000100:00100000:3.0:1787707367.737231:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729760256 00000100:00100000:3.0:1787707367.737292:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787707367.737302:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f68b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729760256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787707367.737335:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707367.737392:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f68b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729760256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707367.737399:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1787707367.737450:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787707367.737612:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729760256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787707367.757885:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707367.758118:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707727744 00000100:00100000:1.0:1787707367.758129:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707727744 00000100:00100000:1.0:1787707367.758194:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 142 00000100:00100000:1.0:1787707367.758204:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+14:11385:x1874546707727744:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:1.0:1787707367.758226:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707367.758249:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec12b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e8e expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758316:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec12bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758330:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec12bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758342:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec12bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758355:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec12c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758363:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec12c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758411:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec12c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758541:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec12c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758551:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec12c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758584:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec12c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707367.758621:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787707367.758624:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787707367.758647:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec12c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758783:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec12bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758790:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec12bb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758797:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec12bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758803:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14a00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707367.758807:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec12bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758815:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec12bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758828:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:1.0:1787707367.758831:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707367.758836:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec12bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758842:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec12bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758866:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec12c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758872:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec12c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758878:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec12c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758882:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14e00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707367.758885:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec12c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758890:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec12c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758957:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cfa204c6500) 00010000:00010000:1.0:1787707367.758960:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707367.758964:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec12c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.758970:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec12c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.759007:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec12b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e8e expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.759022:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec12c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e8e expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.759042:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:1.0:1787707367.759045:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787707367.759048:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a15000, rc 0) 00000100:00100000:1.0:1787707367.759127:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+15:11385:x1874546707727744:12345-192.168.204.46@tcp:101:bash.0 Request processed in 923us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707367.759135:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 142 00000100:00100000:0.0:1787707367.764174:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707367.764941:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707728000 00000100:00100000:2.0:1787707367.764953:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707728000 00000100:00100000:2.0:1787707367.765015:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 143 00000100:00100000:2.0:1787707367.765025:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+15:11385:x1874546707728000:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:2.0:1787707367.765057:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707367.765078:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec12d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e95 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.765207:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec12d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.765220:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec12d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.765230:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec12d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.765297:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec12de lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.765304:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec12de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.765311:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec12de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787707367.766121:0:5858:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787707367.766274:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec12e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.766285:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec12e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.766293:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec12e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.766333:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec12d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.766339:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec12d7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.766345:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec12d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.766351:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871ba00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707367.766355:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec12d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.766361:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec12d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.766398:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:2.0:1787707367.766402:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707367.766406:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec12d7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.766412:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec12d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787707367.766425:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da1ea281 reply state 000000000988af1d transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec12de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707367.766434:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787707367.766464:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec12d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e95 expref: 18 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.767311:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec12e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e95 expref: 17 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.767320:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa12a49200) 00010000:00010000:2.0:1787707367.767323:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787707367.767326:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871b600, rc 0) 00000100:00100000:2.0:1787707367.767811:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+18:11385:x1874546707728000:12345-192.168.204.46@tcp:101:bash.0 Request processed in 2783us (3645us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787707367.767820:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 143 00000100:00100000:1.0:1787707367.775785:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707367.776288:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707728128 00000100:00100000:3.0:1787707367.776299:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707728128 00000100:00100000:3.0:1787707367.776364:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 47 00000100:00100000:3.0:1787707367.776401:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2361:x1874546707728128:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:3.0:1787707367.776420:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707367.776439:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec12f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9e9c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787707367.776488:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707367.776508:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1787707367.776526:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707367.776537:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec12f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e9c expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707367.776558:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec12f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e9c expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707367.776582:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fca00, rc 0) 00000100:00100000:3.0:1787707367.776645:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2361:x1874546707728128:12345-192.168.204.46@tcp:101:bash.0 Request processed in 248us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707367.776663:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 47 00010000:00010000:0.0:1787707367.777756:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec12de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707367.777770:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec12de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707367.777777:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec12de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707367.777783:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871bc00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707367.777788:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec12de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707367.777796:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec12de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707367.777813:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cfa12a49600) 00010000:00010000:0.0:1787707367.777816:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707367.777820:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec12de lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707367.777826:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec12de lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707367.783819:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707367.784060:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707728256 00000100:00100000:1.0:1787707367.784071:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707728256 00000100:00100000:1.0:1787707367.784133:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 48 00000100:00100000:1.0:1787707367.784145:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:11385:x1874546707728256:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:1.0:1787707367.784164:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707367.784182:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec12fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9ea3 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.784214:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec12f3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e9c expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.784224:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707367.784228:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707367.784234:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec12fa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ea3 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.784269:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec12f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e9c expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.784302:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec12f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e9c expref: 7 pid: 6689 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707367.784318:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41a06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1874546729760384:192.168.204.46@tcp:104: 00000100:00100000:1.0:1787707367.784434:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2a5833c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787707367.790136:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707367.791245:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41a06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1874546729760384:192.168.204.46@tcp:104: 00010000:00010000:1.0:1787707367.791288:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec12fa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ea3 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.791311:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a14800, rc 0) 00000100:00100000:1.0:1787707367.791433:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+7:11385:x1874546707728256:12345-192.168.204.46@tcp:101:bash.0 Request processed in 7289us (7626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707367.791442:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 48 00000100:00100000:2.0:1787707367.791826:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707728384 00000100:00100000:2.0:1787707367.791835:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707728384 00010000:00010000:2.0:1787707367.791867:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec12f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e9c expref: 7 pid: 6689 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707367.791916:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 60 00000100:00100000:2.0:1787707367.791926:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2362:x1874546707728384:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787707367.791940:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707367.791966:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec12f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e9c expref: 7 pid: 6689 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.791980:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec12f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e9c expref: 7 pid: 6689 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.792005:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec12f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e9c expref: 7 pid: 6689 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.792040:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707367.792044:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707367.792053:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec12fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ea3 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.792063:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec12fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ea3 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707367.792097:0:8450:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec12fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ea3 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707367.792115:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f688000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8450:1874546729760512:192.168.204.46@tcp:105: 00000100:00100000:2.0:1787707367.792185:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b3540 going to sleep for 11 seconds 00000100:00100000:3.0:1787707367.804241:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707367.806877:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707728640 00000100:00100000:0.0:1787707367.806909:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707728640 00000100:00100000:0.0:1787707367.806984:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 36 00000100:00100000:0.0:1787707367.806995:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+17:11385:x1874546707728640:12345-192.168.204.46@tcp:35:bash.0 00000100:00100000:0.0:1787707367.807366:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+18:11385:x1874546707728640:12345-192.168.204.46@tcp:35:bash.0 Request processed in 371us (3136us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787707367.807408:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 36 00000100:00100000:2.0:1787707367.814962:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f688000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8450:1874546729760512:192.168.204.46@tcp:105: 00010000:00010000:2.0:1787707367.814990:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707367.815133:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2362:x1874546707728384:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 23207us (25008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707367.815144:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 60 00000100:00100000:3.0:1787707367.920814:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707367.920898:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707728896 00000100:00100000:1.0:1787707367.920924:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707728896 00000100:00100000:1.0:1787707367.920995:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 144 00000100:00100000:1.0:1787707367.921006:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+18:11395:x1874546707728896:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:1.0:1787707367.921035:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707367.921059:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec1301 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9eaa expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707367.921177:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787707367.921307:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec1301 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9eaa expref: 20 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.921341:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:1.0:1787707367.921344:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787707367.921351:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec1301 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9eaa expref: 20 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707367.921367:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a14e00, rc 0) 00000100:00100000:1.0:1787707367.928635:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+19:11395:x1874546707728896:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 7617us (8071us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1787707367.928648:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 144 00000100:00100000:3.0:1787707367.933872:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707367.934207:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707729152 00000100:00100000:0.0:1787707367.934218:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707729152 00000100:00100000:0.0:1787707367.934276:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 37 00000100:00100000:0.0:1787707367.934287:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+19:11395:x1874546707729152:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:0.0:1787707367.934881:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+20:11395:x1874546707729152:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 593us (1016us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787707367.934890:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 37 00000100:00100000:1.0:1787707368.028861:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707368.029456:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707729280 00000100:00100000:0.0:1787707368.029468:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707729280 00000100:00100000:0.0:1787707368.029528:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 145 00000100:00100000:0.0:1787707368.029538:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+20:11401:x1874546707729280:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:0.0:1787707368.029574:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707368.029599:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec130f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9eb1 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.029667:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1316 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.029681:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.029693:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707368.029990:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787707368.030006:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787707368.030033:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.030064:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec130f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9eb1 expref: 22 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.030614:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1316 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9eb1 expref: 21 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.030624:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:0.0:1787707368.030628:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787707368.030631:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3a00, rc 0) 00000100:00100000:0.0:1787707368.030815:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+21:11401:x1874546707729280:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 1276us (1964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707368.030823:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 145 00000100:00100000:3.0:1787707368.038987:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707368.039968:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707729536 00000100:00100000:0.0:1787707368.039981:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707729536 00000100:00100000:0.0:1787707368.040035:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 146 00000100:00100000:0.0:1787707368.040045:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+21:11401:x1874546707729536:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:0.0:1787707368.040067:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707368.040089:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec131d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9eb8 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.040204:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1324 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.040218:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.040246:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707368.040258:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787707368.040416:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec131d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9eb8 expref: 24 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.040435:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9eb8 expref: 23 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.040444:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa12a49200) 00010000:00010000:0.0:1787707368.040447:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787707368.040450:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3200, rc 0) 00000100:00100000:0.0:1787707368.040511:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+23:11401:x1874546707729536:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 467us (1536us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787707368.040518:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 146 00000100:00100000:2.0:1787707368.044909:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707368.044998:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707729792 00000100:00100000:0.0:1787707368.045008:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707729792 00000100:00100000:0.0:1787707368.045082:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 147 00000100:00100000:0.0:1787707368.045098:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+23:11401:x1874546707729792:12345-192.168.204.46@tcp:101:lfs.0 00000100:00100000:3.0:1787707368.045185:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707368.045637:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707729920 00000100:00100000:2.0:1787707368.045643:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707729920 00000100:00100000:2.0:1787707368.045695:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 11 00000100:00100000:2.0:1787707368.045703:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+24:2361:x1874546707729920:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787707368.045719:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707368.045757:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1324 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9eb8 expref: 24 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.045776:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa12a49200) 00010000:00010000:2.0:1787707368.045781:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707368.045839:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+23:2361:x1874546707729920:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 136us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707368.045846:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 11 00010000:00010000:0.0:1787707368.046072:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707368.046086:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1332 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9ebf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.046666:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1339 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.046697:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1339 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.046714:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1339 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707368.048194:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787707368.048362:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1332 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ebf expref: 25 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.049684:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1339 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ebf expref: 24 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.049698:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa12a49200) 00010000:00010000:0.0:1787707368.049701:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787707368.049704:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2800, rc 0) 00000100:00100000:0.0:1787707368.049795:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+24:11401:x1874546707729792:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 4702us (4910us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1787707368.049804:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 147 00000100:00100000:3.0:1787707368.057891:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707368.058225:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707730048 00000100:00100000:0.0:1787707368.058237:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707730048 00000100:00100000:0.0:1787707368.058329:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 49 00000100:00100000:0.0:1787707368.058342:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2361:x1874546707730048:12345-192.168.204.46@tcp:1:lfs.0 00000100:00080000:3.0:1787707368.058553:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787707368.058740:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec1347 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.058769:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec12fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ea3 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.058797:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787707368.058802:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787707368.058808:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec1347 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.058854:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec12fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ea3 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.058870:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec12fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ea3 expref: 6 pid: 6690 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707368.058885:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1874546729760640:192.168.204.46@tcp:104: 00000100:00100000:0.0:1787707368.059146:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41fe2300 going to sleep for 11 seconds 00000100:00100000:2.0:1787707368.071540:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707368.074719:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707730176 00000100:00100000:3.0:1787707368.074736:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707730176 00002000:00100000:3.0:1787707368.074800:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8cfa2f68bb80 x1874546707730176/t0(0) o4->9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp:259/0 lens 504/0 e 0 to 0 dl 1787707379 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787707368.074812:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa2f68bb80 with x1874546707730176 ext(0->12) 00010000:00010000:3.0:1787707368.074821:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec12fa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ea3 expref: 7 pid: 6690 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707368.074858:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec12fa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ea3 expref: 7 pid: 6690 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787707368.074867:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cfa2f68bb80 00000100:00100000:3.0:1787707368.074916:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 2 00000100:00100000:3.0:1787707368.074927:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2361:x1874546707730176:12345-192.168.204.46@tcp:4:lfs.0 00000100:00100000:3.0:1787707368.075491:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+9:2361:x1874546707730176:12345-192.168.204.46@tcp:4:lfs.0 Request processed in 564us (3960us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787707368.075500:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 2 00002000:00100000:3.0:1787707368.075508:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8cfa2f68bb80 x1874546707730176/t4294967305(0) o4->9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp:259/0 lens 504/448 e 0 to 0 dl 1787707379 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787707368.075517:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa2f68bb80 with x1874546707730176 ext(0->12) 00010000:00010000:3.0:1787707368.075525:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec12fa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ea3 expref: 9 pid: 6690 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707368.075538:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec12fa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ea3 expref: 9 pid: 6690 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787707368.075546:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cfa2f68bb80 00000100:00100000:0.0:1787707368.080895:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1874546729760640:192.168.204.46@tcp:104: 00010000:00010000:0.0:1787707368.080930:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec1347 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707368.081963:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707368.082052:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707730304 00000100:00100000:1.0:1787707368.082061:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707730304 00010000:00010000:1.0:1787707368.082105:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec12fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ea3 expref: 9 pid: 6690 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707368.082145:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 61 00000100:00100000:1.0:1787707368.082155:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f689180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+9:2359:x1874546707730304:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787707368.082170:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787707368.082190:0:5843:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787707368.082193:0:5843:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787707366 00002000:00010000:1.0:1787707368.082196:0:5843:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787707366 00002000:00010000:1.0:1787707368.082198:0:5843:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787707366 00010000:00010000:1.0:1787707368.082213:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec12fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ea3 expref: 9 pid: 6690 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.082246:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec12fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ea3 expref: 9 pid: 6690 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.082269:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec12fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ea3 expref: 9 pid: 6690 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.082285:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787707368.082290:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787707368.082295:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec1347 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.082305:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec1347 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.082340:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707368.082437:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f689180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2359:x1874546707730304:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 282us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707368.082456:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 61 00010000:00010000:0.0:1787707368.083478:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec1347 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.083491:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec1347 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.083523:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec1347 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.083543:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec1347 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.083551:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec1347 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.083558:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2000 already unused, calling callback (ffffffffc1630230) 00010000:00010000:0.0:1787707368.083573:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec1347 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.083582:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec1347 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.083600:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec1347 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.083607:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec1347 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707368.083808:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2361:x1874546707730048:12345-192.168.204.46@tcp:1:lfs.0 Request processed in 25464us (25926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707368.083816:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 49 00000100:00100000:1.0:1787707368.110214:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707368.110641:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707730560 00000100:00100000:3.0:1787707368.110652:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707730560 00000100:00100000:3.0:1787707368.110714:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 38 00000100:00100000:3.0:1787707368.110725:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa189fec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+24:11401:x1874546707730560:12345-192.168.204.46@tcp:35:lfs.0 00000004:00010000:3.0:1787707368.110807:0:5860:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1339 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ebf expref: 24 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787707368.111167:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1787707368.111207:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1787707368.113490:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1787707368.113590:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec134e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707368.113612:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec12e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e95 expref: 28 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707368.113622:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec134e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707368.113664:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec12e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e95 expref: 28 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707368.113681:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec12e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e95 expref: 28 pid: 5858 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707368.113697:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874546729760768:192.168.204.46@tcp:104: 00000100:00100000:3.0:1787707368.113799:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f4bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787707368.116776:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707368.116929:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707730688 00000100:00100000:0.0:1787707368.116938:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707730688 00010000:00010000:0.0:1787707368.116976:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec12e5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e95 expref: 29 pid: 5858 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707368.117032:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 62 00000100:00100000:0.0:1787707368.117042:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f688380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+29:2361:x1874546707730688:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707368.117058:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707368.117065:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec12e5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e95 expref: 29 pid: 5858 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.117079:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec12e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e95 expref: 29 pid: 5858 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.117101:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa12a49200) 00010000:00010000:0.0:1787707368.117106:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec134e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.117115:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec134e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.117121:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec134e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.117142:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707368.117197:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f688380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+29:2361:x1874546707730688:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 156us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707368.117204:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 62 00010000:00010000:3.0:1787707368.117236:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec12e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e95 expref: 28 pid: 5858 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707368.117257:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874546729760768:192.168.204.46@tcp:104: 00010000:00010000:3.0:1787707368.117279:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec134e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707368.117294:0:5860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec134e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707368.117300:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec134e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787707368.117908:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1787707368.118118:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1787707368.118221:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3abfc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874546729760896:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787707368.118270:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707368.118301:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0734f600 going to sleep for 11 seconds 00000100:00100000:1.0:1787707368.118409:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729760896 00000100:00100000:1.0:1787707368.118415:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729760896 00000100:00100000:1.0:1787707368.118480:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787707368.118489:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5860:x1874546729760896:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787707368.118576:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5860:x1874546729760896:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 88us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707368.118596:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787707368.118623:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3abfc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874546729760896:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1787707368.118772:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1787707368.119074:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787707368.119131:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f688e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874546729761024:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787707368.119167:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707368.119195:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787707368.119327:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729761024 00000100:00100000:1.0:1787707368.119332:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729761024 00000100:00100000:1.0:1787707368.119354:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787707368.119361:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f68aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5860:x1874546729761024:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787707368.119542:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f68aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5860:x1874546729761024:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 181us (374us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787707368.119550:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787707368.122599:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f688e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874546729761024:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787707368.122715:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1787707368.122779:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec134e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.122790:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec134e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.122797:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec134e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.122803:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707368.122822:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec134e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.122830:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec134e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.122848:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa12a49200) 00010000:00010000:2.0:1787707368.122851:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787707368.122857:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec134e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.122864:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec134e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787707368.123230:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787707368.123335:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1787707368.123345:0:5860:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 419169974427ns, next at 420169972375ns, rc = 0 00000001:00080000:2.0:1787707368.123353:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787707368.123417:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa12a49200) 00010000:00010000:2.0:1787707368.123421:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787707368.123429:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1339 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ebf expref: 32 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707368.123573:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa189fec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+31:11401:x1874546707730560:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 12838us (13358us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1787707368.123583:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 38 00000020:00080000:2.0:1787707368.123589:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787707368.127126:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707368.127220:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707730816 00000100:00100000:0.0:1787707368.127231:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707730816 00000100:00100000:0.0:1787707368.127295:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 148 00000100:00100000:0.0:1787707368.127306:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+31:11401:x1874546707730816:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:0.0:1787707368.127345:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707368.127408:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1355 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9ec6 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.127638:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1355 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ec6 expref: 32 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.127654:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1355 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ec6 expref: 32 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.127676:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:1.0:1787707368.127679:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787707368.127682:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2000, rc 0) 00000100:00100000:1.0:1787707368.127738:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+32:11401:x1874546707730816:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 433us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707368.127745:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 148 00000100:00100000:1.0:1787707368.134758:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707368.138337:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707731072 00000100:00100000:0.0:1787707368.138352:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707731072 00000100:00100000:0.0:1787707368.138441:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 39 00000100:00100000:0.0:1787707368.138453:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+32:11401:x1874546707731072:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:1.0:1787707368.138929:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+33:11401:x1874546707731072:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 476us (4179us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1787707368.138938:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 39 00000100:00100000:1.0:1787707368.258772:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707368.259142:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707731328 00000100:00100000:0.0:1787707368.259151:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707731328 00000100:00100000:0.0:1787707368.259314:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 149 00000100:00100000:0.0:1787707368.259325:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+33:11411:x1874546707731328:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:0.0:1787707368.259348:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707368.259385:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec135c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9ecd expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707368.259578:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787707368.259701:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec135c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ecd expref: 35 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.259716:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:0.0:1787707368.259719:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787707368.259725:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec135c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ecd expref: 35 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.259740:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3000, rc 0) 00000100:00100000:0.0:1787707368.259802:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+34:11411:x1874546707731328:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 478us (1038us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1787707368.259824:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 149 00000100:00100000:3.0:1787707368.266707:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707368.266870:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707731456 00000100:00100000:1.0:1787707368.266906:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707731456 00000100:00100000:1.0:1787707368.266968:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 150 00000100:00100000:1.0:1787707368.266979:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+34:11411:x1874546707731456:12345-192.168.204.46@tcp:34:lfs.0 00010000:00010000:1.0:1787707368.267065:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec136a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267085:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec136a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267098:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec136a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267116:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec1371 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267123:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec1371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267130:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec1371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267236:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1378 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267244:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1378 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267250:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1378 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787707368.267295:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1378 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267319:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec136a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267325:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec136a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267331:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec136a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267337:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15a00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707368.267341:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec136a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267349:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec136a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267361:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:1.0:1787707368.267363:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707368.267387:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec136a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267394:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec136a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267405:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec1371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267410:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec1371 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267415:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec1371 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267426:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707368.267429:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec1371 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267435:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec1371 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267625:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cfa204c6500) 00010000:00010000:1.0:1787707368.267628:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707368.267631:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec1371 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267638:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec1371 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267714:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1378 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267721:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1378 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267726:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1378 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267731:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707368.267734:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1378 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267740:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1378 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267759:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:1.0:1787707368.267761:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707368.267765:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1378 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.267770:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1378 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707368.267911:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+34:11411:x1874546707731456:12345-192.168.204.46@tcp:34:lfs.0 Request processed in 932us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707368.267918:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 150 00000100:00100000:1.0:1787707368.274862:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707368.275062:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707731712 00000100:00100000:2.0:1787707368.275072:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707731712 00000100:00100000:2.0:1787707368.275147:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 40 00000100:00100000:2.0:1787707368.275158:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+34:11411:x1874546707731712:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:2.0:1787707368.275460:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+35:11411:x1874546707731712:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 302us (607us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1787707368.275469:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 40 00000100:00100000:3.0:1787707368.329338:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707368.329550:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707731968 00000100:00100000:2.0:1787707368.329571:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707731968 00000100:00100000:2.0:1787707368.329754:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 151 00000100:00100000:2.0:1787707368.329768:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+35:11414:x1874546707731968:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:2.0:1787707368.329796:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707368.329817:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec137f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9ed4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.329929:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec1386 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.329944:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec1386 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.329955:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec1386 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.329969:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec138d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.329976:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec138d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.329982:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec138d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.330118:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec1394 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.330127:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec1394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.330134:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec1394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707368.330142:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787707368.330249:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec1386 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.330257:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec1386 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.330264:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec1386 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.330270:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871ae00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707368.330275:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec1386 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.330282:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec1386 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.330295:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:2.0:1787707368.330298:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707368.330303:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec1386 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.330322:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec1386 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.330335:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec138d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.330342:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec138d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.330348:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec138d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.330352:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707368.330355:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec138d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.330361:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec138d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.330422:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cfa12a49200) 00010000:00010000:2.0:1787707368.330425:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707368.330428:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec138d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.330434:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec138d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.330481:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec137f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ed4 expref: 38 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.330496:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec1394 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ed4 expref: 37 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.330510:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:2.0:1787707368.330512:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787707368.330515:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871aa00, rc 0) 00000100:00100000:2.0:1787707368.330598:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+37:11414:x1874546707731968:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 833us (1278us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1787707368.333159:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707368.333230:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707732096 00000100:00100000:0.0:1787707368.333245:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707732096 00000100:00100000:0.0:1787707368.333320:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 152 00000100:00100000:0.0:1787707368.333331:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+38:11414:x1874546707732096:12345-192.168.204.46@tcp:54:lfs.0 00010000:00010000:0.0:1787707368.333419:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec13a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.333436:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec13a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.333447:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec13a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.333472:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec13a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.333479:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec13a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.333486:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec13a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.333493:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707368.333497:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec13a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.333505:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec13a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.333516:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00000100:00100000:2.0:1787707368.333914:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 151 00010000:00010000:0.0:1787707368.333975:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787707368.333981:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec13a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.333988:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec13a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707368.334100:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+37:11414:x1874546707732096:12345-192.168.204.46@tcp:54:lfs.0 Request processed in 770us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707368.334108:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 152 00000100:00100000:1.0:1787707368.341250:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707368.341406:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707732352 00000100:00100000:2.0:1787707368.341421:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707732352 00000100:00100000:2.0:1787707368.341496:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 41 00000100:00100000:2.0:1787707368.341509:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+37:11414:x1874546707732352:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:2.0:1787707368.342079:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+38:11414:x1874546707732352:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 570us (856us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787707368.342088:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 41 00010000:00010000:1.0:1787707368.698781:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707368.720147:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707368.720501:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707732608 00000100:00100000:1.0:1787707368.720512:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707732608 00000100:00100000:1.0:1787707368.720593:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 153 00000100:00100000:1.0:1787707368.720605:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa1101c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+38:11445:x1874546707732608:12345-192.168.204.46@tcp:101:cat.0 00010000:00010000:1.0:1787707368.720634:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707368.720660:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9edb expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.720771:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec13b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.720788:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec13b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.720801:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec13b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707368.720829:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787707368.720961:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9edb expref: 41 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.720978:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec13b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9edb expref: 40 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.720987:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:1.0:1787707368.720990:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787707368.720993:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a15a00, rc 0) 00000100:00100000:1.0:1787707368.721290:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa1101c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+40:11445:x1874546707732608:12345-192.168.204.46@tcp:101:cat.0 Request processed in 686us (1153us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787707368.721298:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 153 00000100:00100000:0.0:1787707368.726680:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707368.726838:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707732736 00000100:00100000:1.0:1787707368.726848:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707732736 00000100:00100000:0.0:1787707368.727046:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 12 00000100:00100000:0.0:1787707368.727060:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+40:2361:x1874546707732736:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707368.727089:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707368.727118:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec13b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9edb expref: 40 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.727139:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:0.0:1787707368.727144:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707368.727215:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+39:2361:x1874546707732736:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 159us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707368.727223:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 12 00000100:00100000:2.0:1787707368.731867:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707368.731977:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707732992 00000100:00100000:3.0:1787707368.731988:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707732992 00000100:00100000:3.0:1787707368.732057:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 42 00000100:00100000:3.0:1787707368.732077:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+39:11445:x1874546707732992:12345-192.168.204.46@tcp:35:cat.0 00000100:00100000:3.0:1787707368.733733:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+40:11445:x1874546707732992:12345-192.168.204.46@tcp:35:cat.0 Request processed in 1655us (1865us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787707368.733746:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 42 00000100:00100000:3.0:1787707368.801940:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707368.802066:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707733248 00000100:00100000:2.0:1787707368.802077:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707733248 00000100:00100000:2.0:1787707368.802206:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 154 00000100:00100000:2.0:1787707368.802218:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+40:11451:x1874546707733248:12345-192.168.204.46@tcp:101:dd.0 00010000:00010000:2.0:1787707368.802248:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707368.802252:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787707368.802289:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1316 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9eb1 expref: 40 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.802312:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:2.0:1787707368.802318:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787707368.802352:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec13be lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9ee2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.802531:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec13c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.802558:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec1394 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ed4 expref: 40 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.802569:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec13c5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.802608:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec1394 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ed4 expref: 40 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.802625:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec1394 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ed4 expref: 40 pid: 5858 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707368.802640:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f68ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874546729761152:192.168.204.46@tcp:104: 00000100:00100000:2.0:1787707368.802754:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f4b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787707368.813755:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707368.813881:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f68ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874546729761152:192.168.204.46@tcp:104: 00010000:00010000:2.0:1787707368.813914:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec13c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707368.814002:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707733376 00000100:00100000:1.0:1787707368.814009:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707733376 00010000:00010000:1.0:1787707368.814053:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec1394 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ed4 expref: 41 pid: 5858 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707368.814093:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 63 00000100:00100000:1.0:1787707368.814104:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa113cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+41:2361:x1874546707733376:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787707368.814119:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707368.814127:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec1394 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ed4 expref: 41 pid: 5858 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.814170:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec1394 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ed4 expref: 41 pid: 5858 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.814194:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec1394 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ed4 expref: 41 pid: 5858 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.814211:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:1.0:1787707368.814216:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec13c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.814226:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec13c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.814234:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec13c5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.814256:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707368.814310:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa113cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+40:2361:x1874546707733376:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 207us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707368.814318:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 63 00010000:00010000:0.0:1787707368.815064:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec13c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.815074:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec13c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707368.815106:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787707368.816016:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec13be lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ee2 expref: 41 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.816041:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec13c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ee2 expref: 40 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707368.816050:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:0.0:1787707368.816053:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787707368.816055:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871ae00, rc 0) 00000100:00100000:0.0:1787707368.816131:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+40:11451:x1874546707733248:12345-192.168.204.46@tcp:101:dd.0 Request processed in 13915us (14201us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787707368.816140:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 154 00000100:00100000:0.0:1787707368.822218:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707368.822803:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707733632 00000100:00100000:1.0:1787707368.822815:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707733632 00000100:00100000:1.0:1787707368.822887:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 155 00000100:00100000:1.0:1787707368.822899:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+40:11451:x1874546707733632:12345-192.168.204.46@tcp:36:dd.0 00010000:00010000:1.0:1787707368.823187:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.823206:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707368.823234:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787707368.823290:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1787707368.823316:0:8469:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000740e2e3c reply state 0000000012ab13c2 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707368.823325:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787707368.823455:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+43:11451:x1874546707733632:12345-192.168.204.46@tcp:36:dd.0 Request processed in 557us (1246us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1787707368.823463:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 155 00000020:00080000:1.0:1787707368.823468:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787707368.829731:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.829751:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.829790:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.829798:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707368.829804:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.829813:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.829835:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:2.0:1787707368.829839:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707368.829852:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707368.829858:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707369.325255:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707369.325415:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707733760 00000100:00100000:1.0:1787707369.325431:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707733760 00000100:00100000:1.0:1787707369.325512:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 156 00000100:00100000:1.0:1787707369.325523:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+42:11466:x1874546707733760:12345-192.168.204.46@tcp:101:stat.0 00010000:00010000:1.0:1787707369.325561:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707369.325585:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec13da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9ee9 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.325655:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec13e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.325669:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec13e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.325681:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec13e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.325715:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec13e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.325724:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec13e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.325731:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec13e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.325834:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.325846:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec13c5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ee2 expref: 43 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.325855:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13ef lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.325891:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec13c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ee2 expref: 43 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.325907:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec13c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ee2 expref: 43 pid: 5858 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707369.325921:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2a591880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874546729761280:192.168.204.46@tcp:104: 00000100:00100000:1.0:1787707369.326036:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2a583000 going to sleep for 11 seconds 00000100:00080000:3.0:1787707369.326637:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787707369.330100:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2a591880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874546729761280:192.168.204.46@tcp:104: 00010000:00010000:1.0:1787707369.330143:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707369.332608:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707369.333238:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707734016 00000100:00100000:3.0:1787707369.333249:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707734016 00000100:00100000:3.0:1787707369.333432:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 43 00000100:00100000:3.0:1787707369.333445:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+44:5599:x1874546707734016:12345-192.168.204.46@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787707369.333832:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+45:5599:x1874546707734016:12345-192.168.204.46@tcp:35:ldlm_bl.0 Request processed in 390us (1234us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1787707369.333840:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 43 00000100:00100000:3.0:1787707369.337518:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707369.337623:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707734144 00000100:00100000:0.0:1787707369.337635:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707734144 00010000:00010000:0.0:1787707369.337678:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec13c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ee2 expref: 45 pid: 5858 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707369.337732:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 64 00000100:00100000:0.0:1787707369.337742:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+45:2362:x1874546707734144:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707369.337756:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707369.337763:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec13c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ee2 expref: 45 pid: 5858 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.337799:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec13c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ee2 expref: 45 pid: 5858 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.337827:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec13c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ee2 expref: 45 pid: 5858 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.337847:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:0.0:1787707369.337853:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.337863:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.337871:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13ef lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.337913:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707369.337977:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+44:2362:x1874546707734144:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 236us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707369.337985:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 64 00010000:00010000:1.0:1787707369.338223:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.338232:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707369.338279:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787707369.338283:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787707369.338304:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.338318:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.338328:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec13e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.338335:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec13e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.338341:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec13e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.338348:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707369.338352:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec13e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.338360:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec13e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.338403:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:1.0:1787707369.338423:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707369.338428:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec13e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.338435:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec13e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.338449:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec13e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.338455:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec13e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.338462:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec13e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.338471:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707369.338473:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec13e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.338479:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec13e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.338487:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cfa204c6500) 00010000:00010000:1.0:1787707369.338490:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707369.338493:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec13e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.338499:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec13e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.338548:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec13da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ee9 expref: 44 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.338576:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ee9 expref: 43 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.338584:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:1.0:1787707369.338586:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787707369.338588:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a14600, rc 0) 00000100:00100000:1.0:1787707369.338621:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+43:11466:x1874546707733760:12345-192.168.204.46@tcp:101:stat.0 Request processed in 13099us (13375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707369.338628:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 156 00000100:00100000:1.0:1787707369.427292:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707369.427458:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707734400 00000100:00100000:3.0:1787707369.427469:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707734400 00000100:00100000:3.0:1787707369.427547:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 157 00000100:00100000:3.0:1787707369.427559:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+43:11472:x1874546707734400:12345-192.168.204.46@tcp:36:truncate.0 00010000:00010000:3.0:1787707369.427623:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707369.427651:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec13ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ee9 expref: 43 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.427671:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:3.0:1787707369.427676:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787707369.427886:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec13f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.428077:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec13f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.428091:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec13f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787707369.428215:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1787707369.428242:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbe31952 reply state 0000000000a0355b transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec13f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707369.428268:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787707369.428492:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+45:11472:x1874546707734400:12345-192.168.204.46@tcp:36:truncate.0 Request processed in 933us (1209us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1787707369.428500:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 157 00000020:00080000:3.0:1787707369.428505:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787707369.435774:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec13f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707369.435795:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec13f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707369.435803:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec13f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707369.435810:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707369.435815:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec13f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707369.435843:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec13f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707369.435864:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:2.0:1787707369.435867:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707369.435872:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec13f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707369.435954:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec13f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707369.650708:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707369.650816:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707734528 00000100:00100000:0.0:1787707369.650826:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707734528 00000100:00100000:0.0:1787707369.650893:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 158 00000100:00100000:0.0:1787707369.650906:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+44:11486:x1874546707734528:12345-192.168.204.46@tcp:101:stat.0 00010000:00010000:0.0:1787707369.650931:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707369.650954:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec13fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9ef0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651040:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1404 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651054:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651066:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651094:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec140b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651102:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec140b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651109:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec140b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651234:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1412 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651242:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651249:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707369.651285:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787707369.651289:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787707369.651310:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651333:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651341:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651347:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1404 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651353:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1404 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651359:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3a00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707369.651363:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1404 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651402:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1404 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651426:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:0.0:1787707369.651429:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707369.651434:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1404 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651440:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1404 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651455:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec140b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651460:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec140b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651472:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec140b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651477:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707369.651481:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec140b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651486:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec140b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651494:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cfa19f4e600) 00010000:00010000:0.0:1787707369.651496:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707369.651498:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec140b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651503:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec140b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651546:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec13fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ef0 expref: 46 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651560:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ef0 expref: 45 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.651568:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:0.0:1787707369.651570:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787707369.651573:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3000, rc 0) 00000100:00100000:0.0:1787707369.651641:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+45:11486:x1874546707734528:12345-192.168.204.46@tcp:101:stat.0 Request processed in 737us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707369.651658:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 158 00010000:00010000:1.0:1787707369.725346:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707369.769717:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707369.769815:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707734784 00000100:00100000:1.0:1787707369.769826:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707734784 00000100:00100000:1.0:1787707369.769896:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 159 00000100:00100000:1.0:1787707369.769907:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+45:11496:x1874546707734784:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:1.0:1787707369.769930:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707369.769958:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec1419 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9ef7 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707369.770079:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787707369.770221:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec1419 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ef7 expref: 47 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.770236:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:1.0:1787707369.770239:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787707369.770272:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec1419 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ef7 expref: 47 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.770287:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a15400, rc 0) 00000100:00100000:1.0:1787707369.770356:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+46:11496:x1874546707734784:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 451us (652us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1787707369.770363:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 159 00000100:00100000:2.0:1787707369.774559:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707369.774648:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707735040 00000100:00100000:3.0:1787707369.774657:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707735040 00000100:00100000:3.0:1787707369.774714:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 44 00000100:00100000:3.0:1787707369.774724:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa189ff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+46:11496:x1874546707735040:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:3.0:1787707369.774994:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa189ff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+47:11496:x1874546707735040:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 270us (443us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1787707369.775002:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 44 00000100:00100000:0.0:1787707369.786003:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f68ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729761408:0@lo:400:kworker.0 00000100:00100000:0.0:1787707369.786077:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707369.786129:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729761920:0@lo:400:kworker.0 00000100:00100000:0.0:1787707369.786157:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707369.786183:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787707369.786189:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729761536:0@lo:400:kworker.0 00000100:00100000:0.0:1787707369.786210:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707369.786227:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729762048:0@lo:400:kworker.0 00000100:00100000:0.0:1787707369.786249:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707369.786272:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f68a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729761792:0@lo:400:kworker.0 00000100:00100000:0.0:1787707369.786291:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729761408 00000100:00100000:0.0:1787707369.786298:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729761408 00000100:00100000:3.0:1787707369.786301:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707369.786320:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787707369.786325:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f68b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729761664:0@lo:400:kworker.0 00000100:00100000:0.0:1787707369.786340:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787707369.786344:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707369.786350:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07316450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729761408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707369.786426:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07316450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729761408:12345-0@lo:400:kworker.0 Request processed in 77us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707369.786433:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787707369.786466:0:12022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729762048 00000100:00100000:0.0:1787707369.786470:0:12022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729762048 00000100:00100000:0.0:1787707369.786493:0:12022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729761792 00000100:00100000:0.0:1787707369.786495:0:12022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729761792 00000100:00100000:0.0:1787707369.786526:0:12022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787707369.786544:0:12022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3314:x1874546729762048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707369.786576:0:12022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3314:x1874546729762048:12345-0@lo:400:kworker.0 Request processed in 45us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707369.786589:0:12022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787707369.786602:0:12022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787707369.786608:0:12022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729761792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707369.786639:0:12022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729761792:12345-0@lo:400:kworker.0 Request processed in 31us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707369.786645:0:12022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1787707369.786667:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787707369.786701:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729761920 00000100:00100000:3.0:1787707369.786705:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729761920 00000100:00100000:3.0:1787707369.786735:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729761536 00000100:00100000:3.0:1787707369.786739:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729761536 00000100:00100000:3.0:1787707369.786750:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729761664 00000100:00100000:3.0:1787707369.786752:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729761664 00000100:00100000:3.0:1787707369.786766:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787707369.786773:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729761920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707369.786826:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f68a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729761792:0@lo:400:kworker.0 00000100:00080000:0.0:1787707369.786979:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787707369.787061:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787707369.787072:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729761536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707369.788318:0:5858:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787707369.788328:0:5858:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1787707369.788353:0:5856:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787707369.788364:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787707369.788406:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729761664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707369.792834:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729762048:0@lo:400:kworker.0 00000100:00100000:0.0:1787707369.793056:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f68ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729761408:0@lo:400:kworker.0 00000100:00100000:3.0:1787707369.793163:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729761920:12345-0@lo:400:kworker.0 Request processed in 6388us (7003us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707369.793184:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787707369.793300:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729761920:0@lo:400:kworker.0 00000100:00100000:1.0:1787707369.796461:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729761536:12345-0@lo:400:kworker.0 Request processed in 9384us (10241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707369.796475:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787707369.799205:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729761536:0@lo:400:kworker.0 00000100:00100000:2.0:1787707369.799934:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729761664:12345-0@lo:400:kworker.0 Request processed in 11557us (13583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707369.799946:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787707369.802686:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f68b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729761664:0@lo:400:kworker.0 00000001:00080000:2.0:1787707369.834578:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1787707369.834598:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:2.0:1787707369.852473:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707369.852586:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707735296 00000100:00100000:3.0:1787707369.852599:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707735296 00000100:00100000:3.0:1787707369.852670:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 160 00000100:00100000:3.0:1787707369.852681:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+47:11502:x1874546707735296:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:3.0:1787707369.852703:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707369.852724:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1427 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9efe expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.852928:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec142e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.852944:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1412 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ef0 expref: 48 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.852952:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec142e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.852985:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ef0 expref: 48 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.852998:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1412 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ef0 expref: 48 pid: 5858 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707369.853012:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874546729762176:192.168.204.46@tcp:104: 00000100:00100000:3.0:1787707369.853156:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa12a4f180 going to sleep for 11 seconds 00000100:00100000:0.0:1787707369.863021:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707369.865520:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874546729762176:192.168.204.46@tcp:104: 00010000:00010000:3.0:1787707369.865566:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec142e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707369.866237:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707735424 00000100:00100000:1.0:1787707369.866247:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707735424 00010000:00010000:1.0:1787707369.866304:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1412 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ef0 expref: 49 pid: 5858 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707369.866352:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 65 00000100:00100000:1.0:1787707369.866364:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+49:2361:x1874546707735424:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787707369.866413:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707369.866422:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1412 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ef0 expref: 49 pid: 5858 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.866436:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ef0 expref: 49 pid: 5858 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.866485:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1412 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ef0 expref: 49 pid: 5858 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.866502:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:1.0:1787707369.866507:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec142e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.866517:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec142e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.866524:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec142e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707369.866564:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707369.866625:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+48:2361:x1874546707735424:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 263us (3618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707369.866633:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 65 00010000:00010000:3.0:1787707369.866912:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec142e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.866932:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec142e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707369.866952:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1787707369.867181:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1427 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9efe expref: 49 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.867202:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec142e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9efe expref: 48 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.867211:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:3.0:1787707369.867214:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787707369.867217:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fc600, rc 0) 00000100:00100000:3.0:1787707369.867275:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+48:11502:x1874546707735296:12345-192.168.204.46@tcp:101:bash.0 Request processed in 14595us (14811us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1787707369.867283:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 160 00000100:00100000:2.0:1787707369.880657:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707369.880849:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707735680 00000100:00100000:3.0:1787707369.880860:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707735680 00000100:00100000:3.0:1787707369.880921:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 161 00000100:00100000:3.0:1787707369.880933:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f68b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+48:11502:x1874546707735680:12345-192.168.204.46@tcp:36:bash.0 00010000:00010000:3.0:1787707369.881881:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec143c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.881902:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec143c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.881913:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec143c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787707369.881968:0:12425:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1787707369.881997:0:12425:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b7973cf reply state 000000006a3ed1b7 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec143c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707369.882007:0:12425:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787707369.882222:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f68b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+51:11502:x1874546707735680:12345-192.168.204.46@tcp:36:bash.0 Request processed in 1288us (1573us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1787707369.882231:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 161 00000020:00080000:3.0:1787707369.882237:0:12425:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787707369.883936:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec143c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707369.883955:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec143c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707369.884680:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec143c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707369.884687:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fda00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707369.884694:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec143c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707369.884703:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec143c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707369.884721:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:2.0:1787707369.884724:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707369.884729:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec143c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707369.884736:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec143c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707369.888360:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707369.888551:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707735808 00000100:00100000:3.0:1787707369.888569:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707735808 00000100:00100000:3.0:1787707369.888626:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 162 00000100:00100000:3.0:1787707369.888636:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+50:11502:x1874546707735808:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:3.0:1787707369.888660:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707369.888681:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1443 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f05 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.888976:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec144a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.888993:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec142e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9efe expref: 51 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.889072:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec144a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.889108:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec142e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9efe expref: 51 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.889123:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec142e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9efe expref: 51 pid: 5857 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707369.889137:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874546729762304:192.168.204.46@tcp:104: 00000100:00100000:3.0:1787707369.889228:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05ebc000 going to sleep for 11 seconds 00000100:00100000:1.0:1787707369.898809:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707369.898891:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707735936 00000100:00100000:0.0:1787707369.898908:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707735936 00010000:00010000:0.0:1787707369.898954:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec142e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9efe expref: 52 pid: 5857 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707369.899000:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 66 00000100:00100000:0.0:1787707369.899011:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+52:2362:x1874546707735936:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707369.899029:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707369.899036:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec142e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9efe expref: 52 pid: 5857 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.899050:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec142e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9efe expref: 52 pid: 5857 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.899095:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:0.0:1787707369.899100:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec144a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.899109:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec144a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.899132:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec144a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707369.899156:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707369.899221:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+52:2362:x1874546707735936:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 210us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707369.899229:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 66 00010000:00010000:3.0:1787707369.900607:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec142e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9efe expref: 51 pid: 5857 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707369.900630:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874546729762304:192.168.204.46@tcp:104: 00010000:00010000:3.0:1787707369.900652:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec144a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.900662:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec144a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.900667:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec144a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707369.900712:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787707369.900716:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787707369.900738:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec144a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.900784:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1443 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f05 expref: 51 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.900799:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec144a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f05 expref: 50 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707369.900807:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:3.0:1787707369.900810:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787707369.900812:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fca00, rc 0) 00000100:00100000:3.0:1787707369.904008:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+50:11502:x1874546707735808:12345-192.168.204.46@tcp:101:bash.0 Request processed in 15349us (15635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707369.904024:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 162 00000100:00100000:1.0:1787707369.910809:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707369.910967:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707736192 00000100:00100000:3.0:1787707369.910977:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707736192 00000100:00100000:3.0:1787707369.911039:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 45 00000100:00100000:3.0:1787707369.911051:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+50:11502:x1874546707736192:12345-192.168.204.46@tcp:35:bash.0 00000100:00100000:3.0:1787707369.911320:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+51:11502:x1874546707736192:12345-192.168.204.46@tcp:35:bash.0 Request processed in 270us (521us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1787707369.911328:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 45 00000100:00100000:1.0:1787707370.031688:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707370.031872:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707736448 00000100:00100000:3.0:1787707370.031882:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707736448 00000100:00100000:3.0:1787707370.031936:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 163 00000100:00100000:3.0:1787707370.031947:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+51:11512:x1874546707736448:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:3.0:1787707370.031970:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707370.031991:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1451 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f0c expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707370.032128:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787707370.032258:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1451 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f0c expref: 53 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707370.032273:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:3.0:1787707370.032276:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787707370.032281:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1451 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f0c expref: 53 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707370.032295:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fd400, rc 0) 00000100:00100000:3.0:1787707370.032363:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+52:11512:x1874546707736448:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 417us (685us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1787707370.032408:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 163 00000100:00100000:1.0:1787707370.035444:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707370.035560:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707736576 00000100:00100000:3.0:1787707370.035580:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707736576 00000100:00100000:2.0:1787707370.035751:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 164 00000100:00100000:2.0:1787707370.035768:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+52:11512:x1874546707736576:12345-192.168.204.46@tcp:34:lfs.0 00010000:00010000:2.0:1787707370.035880:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec145f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.035899:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec145f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.035912:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec145f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.035947:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1466 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.035955:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.035962:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036079:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec146d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036088:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec146d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036095:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec146d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787707370.036139:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec146d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036151:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec145f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036158:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec145f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036164:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec145f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036170:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871be00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707370.036174:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec145f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036188:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec145f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036200:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:2.0:1787707370.036217:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707370.036223:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec145f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036230:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec145f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036243:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036249:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1466 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036255:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1466 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036261:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707370.036263:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1466 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036269:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1466 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036275:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cfa12a49900) 00010000:00010000:2.0:1787707370.036278:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707370.036281:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1466 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036297:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1466 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036314:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec146d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036320:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec146d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036326:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec146d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036330:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871aa00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707370.036333:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec146d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036339:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec146d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036346:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:2.0:1787707370.036348:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707370.036352:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec146d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.036357:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec146d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707370.036483:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+52:11512:x1874546707736576:12345-192.168.204.46@tcp:34:lfs.0 Request processed in 720us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707370.036492:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 164 00000100:00100000:2.0:1787707370.048537:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707370.048758:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707736832 00000100:00100000:3.0:1787707370.048774:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707736832 00000100:00100000:3.0:1787707370.048859:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 46 00000100:00100000:3.0:1787707370.048873:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+52:11512:x1874546707736832:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:3.0:1787707370.049258:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+53:11512:x1874546707736832:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 386us (760us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787707370.049267:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 46 00000100:00100000:1.0:1787707370.119142:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707370.119318:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707737088 00000100:00100000:3.0:1787707370.119332:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707737088 00000100:00100000:3.0:1787707370.119452:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 165 00000100:00100000:3.0:1787707370.119465:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+53:11515:x1874546707737088:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:3.0:1787707370.119541:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707370.119579:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1474 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f13 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.120303:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec147b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.120324:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec147b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.120339:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec147b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.120358:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1482 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.120366:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.120403:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.120755:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1489 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.120766:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.120774:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707370.120787:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787707370.120925:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec147b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.120933:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec147b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.120952:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec147b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.120958:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871aa00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707370.120963:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec147b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.120970:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec147b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.120986:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:2.0:1787707370.120989:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707370.120995:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec147b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.121001:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec147b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.121019:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.121026:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1482 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.121032:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.121037:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707370.121041:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.121062:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1482 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.121071:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cfa12a49900) 00010000:00010000:2.0:1787707370.121073:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707370.121076:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1482 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.121081:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1482 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.121136:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1474 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f13 expref: 56 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.121156:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1489 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f13 expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.121164:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:2.0:1787707370.121167:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787707370.121169:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871be00, rc 0) 00000100:00100000:2.0:1787707370.121268:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+55:11515:x1874546707737088:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 1803us (2144us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787707370.121276:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 165 00000100:00100000:1.0:1787707370.141302:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707370.141367:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707370.141513:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707737216 00000100:00100000:2.0:1787707370.141537:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707737216 00000100:00100000:2.0:1787707370.141624:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 166 00000100:00100000:2.0:1787707370.141639:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+55:11515:x1874546707737216:12345-192.168.204.46@tcp:54:lfs.0 00010000:00010000:2.0:1787707370.141763:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1497 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.141787:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.141801:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.141841:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.141848:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1497 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.141856:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1497 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.141863:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707370.141869:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1497 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.141878:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1497 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.141892:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:2.0:1787707370.141896:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787707370.141902:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1497 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.141909:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1497 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707370.142020:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+55:11515:x1874546707737216:12345-192.168.204.46@tcp:54:lfs.0 Request processed in 384us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707370.142029:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 166 00000100:00100000:3.0:1787707370.142983:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707737344 00000100:00100000:3.0:1787707370.142994:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707737344 00000100:00100000:3.0:1787707370.143058:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 13 00000100:00100000:3.0:1787707370.143068:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+55:2359:x1874546707737344:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787707370.143085:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707370.143110:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1489 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f13 expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707370.143129:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:3.0:1787707370.143133:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707370.143181:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+54:2359:x1874546707737344:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 115us (1813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707370.143189:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 13 00000100:00100000:1.0:1787707370.149772:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707370.153688:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707737600 00000100:00100000:3.0:1787707370.153711:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707737600 00000100:00100000:2.0:1787707370.155359:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 47 00000100:00100000:2.0:1787707370.155398:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+54:11515:x1874546707737600:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:2.0:1787707370.156213:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+55:11515:x1874546707737600:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 838us (6454us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1787707370.156222:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 47 00000004:00080000:3.0:1787707370.296746:0:7933:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 421343370731ns, next at 422343366921ns, rc = 0 00000100:00100000:1.0:1787707370.296969:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729762432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787707370.297073:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707370.297321:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729762432 00000100:00100000:3.0:1787707370.297332:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729762432 00000100:00100000:3.0:1787707370.297452:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787707370.297465:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729762432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787707370.297548:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707370.297612:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729762432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707370.297631:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787707370.297687:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1787707370.297694:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1787707370.297729:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729762432:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787707370.298548:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787707370.384672:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707370.384863:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707737856 00000100:00100000:3.0:1787707370.384939:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707737856 00000100:00100000:3.0:1787707370.385028:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 167 00000100:00100000:3.0:1787707370.385041:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f68ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+55:11533:x1874546707737856:12345-192.168.204.46@tcp:101:cat.0 00010000:00010000:3.0:1787707370.385085:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707370.385116:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec149e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f1a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707370.385262:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec14a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707370.385280:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec14a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707370.385293:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec14a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707370.385307:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787707370.385527:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec149e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f1a expref: 58 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707370.385551:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec14a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f1a expref: 57 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707370.385582:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:3.0:1787707370.385585:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787707370.385589:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fd600, rc 0) 00000100:00100000:3.0:1787707370.385947:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f68ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+57:11533:x1874546707737856:12345-192.168.204.46@tcp:101:cat.0 Request processed in 839us (1219us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787707370.385958:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 167 00000100:00100000:1.0:1787707370.419803:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707370.421065:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707737984 00000100:00100000:3.0:1787707370.421090:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707737984 00000100:00100000:3.0:1787707370.421277:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 168 00000100:00100000:3.0:1787707370.421292:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+57:11534:x1874546707737984:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:3.0:1787707370.421326:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707370.421358:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec14b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f21 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707370.421531:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec14ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707370.421551:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec14ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707370.421564:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec14ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707370.421654:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787707370.421659:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787707370.421690:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec14ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707370.421767:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec14b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f21 expref: 59 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707370.421806:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec14ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f21 expref: 58 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707370.421817:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:3.0:1787707370.421820:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787707370.421825:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fd400, rc 0) 00000100:00100000:3.0:1787707370.421941:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+58:11534:x1874546707737984:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 652us (2160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707370.421949:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 168 00000100:00100000:1.0:1787707370.436720:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707370.437080:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707738368 00000100:00100000:3.0:1787707370.437097:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707738368 00000100:00100000:3.0:1787707370.437184:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 48 00000100:00100000:3.0:1787707370.437198:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+58:11534:x1874546707738368:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:3.0:1787707370.438062:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+59:11534:x1874546707738368:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 861us (1352us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787707370.438073:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 48 00000100:00100000:0.0:1787707370.450840:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707370.451065:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707738496 00000100:00100000:1.0:1787707370.451080:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707738496 00000100:00100000:1.0:1787707370.451181:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 14 00000100:00100000:1.0:1787707370.451195:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+59:11534:x1874546707738496:12345-192.168.204.46@tcp:103:lfs.0 00010000:00010000:1.0:1787707370.451218:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787707370.451259:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec144a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f05 expref: 59 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707370.451290:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec14a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f1a expref: 58 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707370.451307:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1355 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ec6 expref: 57 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707370.451319:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4eb00) 00010000:00010000:1.0:1787707370.451334:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707370.451490:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+56:11534:x1874546707738496:12345-192.168.204.46@tcp:103:lfs.0 Request processed in 298us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707370.451499:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 14 00000100:00100000:1.0:1787707370.454424:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707370.454607:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707738624 00000100:00100000:0.0:1787707370.454621:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707738624 00000100:00100000:0.0:1787707370.454711:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 169 00000100:00100000:0.0:1787707370.454726:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+56:11534:x1874546707738624:12345-192.168.204.46@tcp:58:lfs.0 00010000:00010000:0.0:1787707370.455320:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec14c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707370.455346:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec14c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707370.455362:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec14c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787707370.463932:0:12425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1787707370.464161:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+56:11534:x1874546707738624:12345-192.168.204.46@tcp:58:lfs.0 Request processed in 9427us (9742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707370.464223:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 169 00000100:00100000:3.0:1787707370.534693:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707370.536163:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707738752 00000100:00100000:2.0:1787707370.536189:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707738752 00000100:00100000:2.0:1787707370.536316:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 170 00000100:00100000:2.0:1787707370.536330:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+56:11536:x1874546707738752:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:2.0:1787707370.536359:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707370.536452:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec14c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f28 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.536574:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec14cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.536594:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec14cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.536611:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec14cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.536632:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec14d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.536663:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec14d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.536671:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec14d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.537014:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec14dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.537026:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec14dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.537033:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec14dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707370.537081:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787707370.537087:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787707370.537110:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec14dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.537124:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec14dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.537133:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec14cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.537139:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec14cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.537146:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec14cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.537164:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871a600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707370.537169:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec14cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.537177:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec14cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.537191:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:2.0:1787707370.537194:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707370.537200:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec14cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.537205:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec14cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.537222:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec14d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.537297:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec14d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.537302:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec14d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.537307:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707370.537310:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec14d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.537316:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec14d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.537335:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cfa12a49900) 00010000:00010000:2.0:1787707370.537338:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707370.537341:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec14d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.537347:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec14d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.537446:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec14c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f28 expref: 58 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.537466:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec14dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f28 expref: 57 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707370.537475:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4e600) 00010000:00010000:2.0:1787707370.537478:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787707370.537481:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871aa00, rc 0) 00000100:00100000:2.0:1787707370.539339:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+57:11536:x1874546707738752:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 2993us (4640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707370.539355:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 170 00010000:00010000:3.0:1787707370.745365:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787707371.399574:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000001:00080000:0.0:1787707371.399630:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967445 is committed 00000001:00080000:0.0:1787707371.399641:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000004:00080000:0.0:1787707371.399657:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787707371.399678:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cfa065b3a80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1787707371.399684:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfa418e1800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cfa065b3540 00000020:00080000:0.0:1787707371.399688:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfa418e1300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cfa3ab95400 00000100:00100000:2.0:1787707371.400140:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729762560:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1787707371.400170:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:0.0:1787707371.400177:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787707371.400227:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1787707371.400438:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787707371.400539:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707371.402468:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707371.402516:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707738880 00000100:00100000:1.0:1787707371.402525:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707371.402527:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707738880 00000100:00100000:3.0:1787707371.402585:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 304 00000100:00100000:3.0:1787707371.402595:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07315050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:2362:x1874546707738880:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707371.402696:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07315050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:2362:x1874546707738880:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 102us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707371.402706:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 304 00000100:00100000:1.0:1787707371.405400:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707371.405437:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729762560 00000100:00100000:0.0:1787707371.405447:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729762560 00000100:00100000:1.0:1787707371.405656:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707371.405745:0:12022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707739136 00000100:00100000:2.0:1787707371.405750:0:12022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707739136 00000100:00100000:2.0:1787707371.405793:0:12022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707739008 00000100:00100000:2.0:1787707371.405796:0:12022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707739008 00000100:00100000:2.0:1787707371.405819:0:12022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 102 00000100:00100000:2.0:1787707371.405830:0:12022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2362:x1874546707739136:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707371.405910:0:12022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2362:x1874546707739136:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 80us (3384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707371.405919:0:12022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 102 00000100:00100000:2.0:1787707371.405939:0:12022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 103 00000100:00100000:2.0:1787707371.405947:0:12022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2362:x1874546707739008:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707371.405991:0:12022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2362:x1874546707739008:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 45us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707371.405997:0:12022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 103 00000100:00100000:2.0:1787707371.406011:0:12022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787707371.406018:0:12022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f68a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729762560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787707371.406039:0:12022:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1787707371.406073:0:12022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8e3fe6, atime: 0x6a8e3fe6, ctime: 0x6a8e3fe6, blocks: 0xb 00010000:00010000:2.0:1787707371.406081:0:12022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cca50419/0xc5f18d5f94ec14e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.406098:0:12022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1787707371.406102:0:12022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707371.406109:0:12022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cca50419/0xc5f18d5f94ec14e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.406126:0:12022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cca50419/0xc5f18d5f94ec14e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.406136:0:12022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cca50419/0xc5f18d5f94ec14e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.406155:0:12022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cca50419/0xc5f18d5f94ec14e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.406349:0:12022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787707371.408785:0:12022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f68a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3317:x1874546729762560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2759us (8237us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787707371.408796:0:12022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:2.0:1787707371.408999:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfa2f689180/2, rc 0, transno 4294967307 00000100:00100000:2.0:1787707371.409007:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729762560:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1787707371.409825:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787707371.409834:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787707371.409849:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707739264 00000100:00100000:0.0:1787707371.409857:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707739264 00000100:00100000:0.0:1787707371.409922:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 179 00000100:00100000:0.0:1787707371.409933:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2362:x1874546707739264:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707371.410015:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2362:x1874546707739264:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 84us (4360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707371.410022:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 179 00000100:00080000:2.0:1787707371.410190:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787707371.410818:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787707371.410829:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cca50419/0xc5f18d5f94ec14e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.411280:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b600 already unused, calling callback (ffffffffc1630230) 00010000:00010000:1.0:1787707371.411286:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cca50419/0xc5f18d5f94ec14e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.411298:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cca50419/0xc5f18d5f94ec14e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.411322:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cca50419/0xc5f18d5f94ec14e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.411330:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cca50419/0xc5f18d5f94ec14e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.411356:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707371.411358:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707371.411360:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787707371.448694:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787707371.448704:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787707371.448775:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787707371.448783:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787707371.448914:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4c9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874546729762688:192.168.204.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787707371.449093:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa19e956c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787707371.455487:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4c9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874546729762688:192.168.204.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787707371.462310:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707371.463748:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707739392 00000100:00100000:3.0:1787707371.463762:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707739392 00000100:00080000:2.0:1787707371.463829:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707371.463877:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 171 00000100:00100000:3.0:1787707371.463889:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+16:11547:x1874546707739392:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787707371.463923:0:12425:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787707371.464064:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+16:11547:x1874546707739392:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 Request processed in 176us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707371.464073:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 171 00000100:00100000:2.0:1787707371.470829:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707371.470877:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707739520 00000100:00100000:1.0:1787707371.470888:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707739520 00000100:00100000:1.0:1787707371.470952:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 172 00000100:00100000:1.0:1787707371.470979:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+16:11547:x1874546707739520:12345-192.168.204.46@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787707371.471067:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec14eb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471084:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec14eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471098:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec14eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471113:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec14f2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471119:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec14f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471125:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec14f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471153:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec14f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471162:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec14f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471168:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec14f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707371.471209:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787707371.471214:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787707371.471228:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec14f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471249:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec14eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471255:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec14eb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471262:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec14eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471268:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14e00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707371.471272:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec14eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471279:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec14eb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471291:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfa06897a00) 00010000:00010000:1.0:1787707371.471293:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707371.471298:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec14eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471304:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec14eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471316:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec14f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471322:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec14f2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471327:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec14f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471338:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707371.471341:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec14f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471346:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec14f2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471355:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8cfa204c6300) 00010000:00010000:1.0:1787707371.471357:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707371.471360:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec14f2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471366:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec14f2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471413:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec14f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471420:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec14f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471426:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec14f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471431:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14a00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707371.471434:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec14f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471440:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec14f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471459:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4e600) 00010000:00010000:1.0:1787707371.471462:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707371.471465:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec14f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.471471:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec14f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707371.471554:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+16:11547:x1874546707739520:12345-192.168.204.46@tcp:34:lhsmtool_posix.0 Request processed in 577us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707371.471562:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 172 00000100:00100000:0.0:1787707371.482476:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707371.482881:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707739776 00000100:00100000:3.0:1787707371.482891:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707739776 00000100:00100000:3.0:1787707371.482956:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 173 00000100:00100000:3.0:1787707371.482967:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+16:11547:x1874546707739776:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787707371.482987:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707371.483009:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1500 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f2f expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.483636:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1507 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.483653:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.483665:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707371.483677:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787707371.483879:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.483887:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1507 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.483894:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1507 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.483900:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fda00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707371.483904:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1507 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.483911:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1507 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.483924:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4e600) 00010000:00010000:3.0:1787707371.483926:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787707371.483931:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1507 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.483948:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1507 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.483997:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1500 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f2f expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.484008:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfa06897a00) 00010000:00010000:3.0:1787707371.484010:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787707371.484014:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1500 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f2f expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.484037:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fc600, rc 0) 00000100:00100000:3.0:1787707371.484115:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+17:11547:x1874546707739776:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 1149us (1645us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787707371.484123:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 173 00000100:00100000:2.0:1787707371.494238:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707371.494731:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707739904 00000100:00100000:0.0:1787707371.494743:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707739904 00000100:00100000:0.0:1787707371.494814:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 174 00000100:00100000:0.0:1787707371.494827:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+17:11547:x1874546707739904:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787707371.494869:0:12425:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787707371.494993:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+17:11547:x1874546707739904:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 Request processed in 168us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707371.495009:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 174 00000100:00100000:0.0:1787707371.512602:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707371.518899:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707740160 00000100:00100000:1.0:1787707371.518917:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707740160 00000100:00100000:1.0:1787707371.519126:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 175 00000100:00100000:1.0:1787707371.519137:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+17:11547:x1874546707740160:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787707371.519158:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707371.519162:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787707371.519242:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec14ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f21 expref: 17 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.519270:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:1.0:1787707371.519275:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787707371.519292:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1515 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f36 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787707371.528300:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1787707371.530896:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec151c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.530929:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec151c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.534724:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec151c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.534876:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1515 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f36 expref: 19 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.534896:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec151c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f36 expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.534907:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cfa204c6300) 00010000:00010000:1.0:1787707371.534910:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787707371.534914:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a14800, rc 0) 00000100:00100000:1.0:1787707371.536924:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+18:11547:x1874546707740160:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 17778us (24321us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1787707371.536938:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 175 00000100:00100000:2.0:1787707371.550788:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707371.552809:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707740416 00000100:00100000:3.0:1787707371.552826:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707740416 00000100:00100000:3.0:1787707371.552899:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 176 00000100:00100000:3.0:1787707371.552910:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+18:11547:x1874546707740416:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787707371.552971:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707371.553165:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec151c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f36 expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.553186:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cfa204c6300) 00010000:00010000:3.0:1787707371.553198:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787707371.553224:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec152a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.553441:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec152a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.553454:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec152a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.553470:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1531 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x9309e8ed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.553478:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9309e8ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.553484:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9309e8ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.553857:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec152a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.553866:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec152a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.553873:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec152a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.553879:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707371.553884:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec152a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.553891:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec152a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.553900:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:3.0:1787707371.553909:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707371.553913:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec152a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.553919:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec152a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.553932:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9309e8ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.553938:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1531 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9309e8ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.553944:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1531 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9309e8ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.553949:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fda00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707371.553952:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1531 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9309e8ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.553958:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1531 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9309e8ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.553964:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x9309e8ed (ffff8cfa143e4b00) 00010000:00010000:3.0:1787707371.553967:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707371.553970:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1531 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9309e8ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.553975:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec1531 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9309e8ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707371.555481:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+17:11547:x1874546707740416:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 Request processed in 2563us (4697us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787707371.555518:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 176 00000100:00100000:3.0:1787707371.560953:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707371.562690:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707740544 00000100:00100000:1.0:1787707371.562706:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707740544 00000100:00100000:1.0:1787707371.562775:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 177 00000100:00100000:1.0:1787707371.562788:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+17:11547:x1874546707740544:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787707371.562814:0:12425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707371.562842:0:12425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1538 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f3d expref: -99 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.562884:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec153f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.562910:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec153f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.562925:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec153f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.563030:0:12425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1538 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f3d expref: 19 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.563046:0:12425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec153f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f3d expref: 18 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.563055:0:12425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cfa204c6a00) 00010000:00010000:1.0:1787707371.563057:0:12425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787707371.563060:0:12425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a14e00, rc 0) 00000100:00100000:1.0:1787707371.563129:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+18:11547:x1874546707740544:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 344us (2187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707371.563136:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 177 00000100:00100000:0.0:1787707371.573919:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707371.575626:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707740800 00000100:00100000:1.0:1787707371.575640:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707740800 00000100:00100000:1.0:1787707371.575722:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 178 00000100:00100000:1.0:1787707371.575734:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+18:11547:x1874546707740800:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787707371.575834:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1546 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.575851:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.575875:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787707371.576185:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1787707371.576196:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 422622824963ns, next at 423622822329ns, rc = 0 00000004:00010000:1.0:1787707371.576286:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005edf654a reply state 00000000a7abace3 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707371.576294:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787707371.576409:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+20:11547:x1874546707740800:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 Request processed in 677us (2499us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1787707371.576417:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 178 00000040:00080000:1.0:1787707371.577481:0:12465:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787707371.577488:0:12465:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787707371.577546:0:12465:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787707371.577552:0:12465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787707371.580358:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.580438:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1546 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.580446:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1546 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.580453:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14a00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707371.580458:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1546 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.580466:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1546 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.580495:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cfa204c6a00) 00010000:00010000:2.0:1787707371.580509:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787707371.580515:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1546 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.580522:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1546 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707371.606948:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707371.606989:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707740928 00000100:00100000:0.0:1787707371.606998:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707740928 00000100:00100000:0.0:1787707371.607056:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 179 00000100:00100000:0.0:1787707371.607067:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+19:11547:x1874546707740928:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787707371.607093:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707371.607115:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec154d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f44 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.607176:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec154d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f44 expref: 20 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.607192:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec154d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f44 expref: 20 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.607212:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cfa204c6a00) 00010000:00010000:0.0:1787707371.607215:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787707371.607407:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2800, rc 0) 00000100:00100000:0.0:1787707371.607599:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+20:11547:x1874546707740928:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 532us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707371.607606:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 179 00000100:00100000:3.0:1787707371.612973:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707371.613168:0:12022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707741056 00000100:00100000:0.0:1787707371.613178:0:12022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707741056 00000100:00100000:0.0:1787707371.613259:0:12022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 51 00000100:00100000:0.0:1787707371.613270:0:12022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2360:x1874546707741056:12345-192.168.204.46@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787707371.613868:0:12022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2360:x1874546707741056:12345-192.168.204.46@tcp:2:lhsmtool_posix.0 Request processed in 598us (905us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787707371.613877:0:12022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 51 00000100:00100000:0.0:1787707371.619329:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707371.619603:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707741312 00000100:00100000:3.0:1787707371.619621:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707741312 00000100:00100000:3.0:1787707371.619685:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 49 00000100:00100000:3.0:1787707371.619698:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+20:11547:x1874546707741312:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787707371.620154:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+21:11547:x1874546707741312:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 Request processed in 457us (831us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787707371.620168:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 49 00000100:00100000:1.0:1787707371.630573:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707371.630872:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707741568 00000100:00100000:3.0:1787707371.630883:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707741568 00000100:00100000:3.0:1787707371.630939:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 180 00000100:00100000:3.0:1787707371.630950:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+21:11547:x1874546707741568:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787707371.631068:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+21:11547:x1874546707741568:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 Request processed in 120us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707371.631075:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 180 00000100:00100000:1.0:1787707371.648417:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707371.648717:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707741696 00000100:00100000:2.0:1787707371.648729:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707741696 00000100:00100000:2.0:1787707371.648792:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 181 00000100:00100000:2.0:1787707371.648803:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+21:11547:x1874546707741696:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787707371.648825:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707371.648848:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1554 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f4b expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.648922:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec155b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.648938:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec155b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.648950:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec155b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707371.648986:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787707371.649005:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec155b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.649031:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1554 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f4b expref: 23 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.649063:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec155b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f4b expref: 22 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.649072:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cfa204c6a00) 00010000:00010000:2.0:1787707371.649075:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787707371.649079:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871a800, rc 0) 00000100:00100000:2.0:1787707371.649139:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+22:11547:x1874546707741696:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 336us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707371.649146:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 181 00000100:00100000:2.0:1787707371.671835:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707371.671939:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707741824 00000100:00100000:1.0:1787707371.671954:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707741824 00000100:00100000:1.0:1787707371.672017:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 52 00000100:00100000:1.0:1787707371.672028:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa35b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2362:x1874546707741824:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787707371.672047:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707371.672068:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc53c332/0xc5f18d5f94ec1562 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f52 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787707371.672096:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8e3fea, blocks: 0x1 00010000:00010000:1.0:1787707371.672135:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1787707371.672140:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707371.672151:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc53c332/0xc5f18d5f94ec1562 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f52 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.672172:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dc53c332/0xc5f18d5f94ec1562 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f52 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.672187:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a15400, rc 0) 00000100:00100000:1.0:1787707371.672505:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa35b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2362:x1874546707741824:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 466us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707371.672513:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 52 00000100:00100000:2.0:1787707371.677171:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707371.677257:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707742080 00000100:00100000:1.0:1787707371.677266:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707742080 00000100:00100000:1.0:1787707371.677324:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 182 00000100:00100000:1.0:1787707371.677335:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+22:11547:x1874546707742080:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787707371.677504:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+22:11547:x1874546707742080:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 Request processed in 161us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707371.677513:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 182 00000100:00100000:3.0:1787707371.692590:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707371.692952:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707742208 00000100:00100000:2.0:1787707371.692962:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707742208 00000100:00100000:2.0:1787707371.693012:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 53 00000100:00100000:2.0:1787707371.693022:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+8:11547:x1874546707742208:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787707371.693039:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707371.693059:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013a3e229/0xc5f18d5f94ec1569 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f59 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.693094:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc53c332/0xc5f18d5f94ec1562 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f52 expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.693103:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707371.693107:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707371.693114:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013a3e229/0xc5f18d5f94ec1569 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f59 expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.693167:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc53c332/0xc5f18d5f94ec1562 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f52 expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.693182:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc53c332/0xc5f18d5f94ec1562 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f52 expref: 9 pid: 6688 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707371.693198:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1874546729762816:192.168.204.46@tcp:104: 00000100:00100000:2.0:1787707371.693298:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0734f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707371.697794:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1874546729762816:192.168.204.46@tcp:104: 00010000:00010000:1.0:1787707371.697854:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000013a3e229/0xc5f18d5f94ec1569 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f59 expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.697881:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871ba00, rc 0) 00000100:00100000:1.0:1787707371.697963:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+9:11547:x1874546707742208:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 4941us (5383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707371.697982:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 53 00000100:00100000:2.0:1787707371.699999:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707371.700078:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707742336 00000100:00100000:1.0:1787707371.700089:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707742336 00010000:00010000:1.0:1787707371.700137:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc53c332/0xc5f18d5f94ec1562 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f52 expref: 9 pid: 6688 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707371.700185:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 67 00000100:00100000:1.0:1787707371.700195:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+9:2362:x1874546707742336:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787707371.700211:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707371.700248:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc53c332/0xc5f18d5f94ec1562 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f52 expref: 9 pid: 6688 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.700265:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc53c332/0xc5f18d5f94ec1562 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f52 expref: 9 pid: 6688 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.700290:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc53c332/0xc5f18d5f94ec1562 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f52 expref: 9 pid: 6688 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.700307:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707371.700311:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707371.700319:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013a3e229/0xc5f18d5f94ec1569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f59 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.700329:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013a3e229/0xc5f18d5f94ec1569 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f59 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.700416:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000013a3e229/0xc5f18d5f94ec1569 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f59 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707371.700432:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5841:1874546729762944:192.168.204.46@tcp:105: 00000100:00100000:1.0:1787707371.700514:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05edb600 going to sleep for 11 seconds 00000100:00100000:1.0:1787707371.719742:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707371.719801:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5841:1874546729762944:192.168.204.46@tcp:105: 00010000:00010000:1.0:1787707371.719824:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707371.719892:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2362:x1874546707742336:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 19697us (19902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707371.719904:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 67 00000100:00100000:1.0:1787707371.719952:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707742464 00000100:00100000:1.0:1787707371.719959:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707742464 00002000:00100000:1.0:1787707371.720000:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8cfa41ca0a80 x1874546707742464/t0(0) o4->9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp:262/0 lens 504/0 e 0 to 0 dl 1787707382 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787707371.720010:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa41ca0a80 with x1874546707742464 ext(0->8) 00002000:00010000:1.0:1787707371.720015:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfa41ca0a80 00000100:00100000:1.0:1787707371.720038:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 4 00000100:00100000:1.0:1787707371.720047:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2361:x1874546707742464:12345-192.168.204.46@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787707371.720491:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+10:2361:x1874546707742464:12345-192.168.204.46@tcp:4:lhsmtool_posix.0 Request processed in 443us (759us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787707371.720511:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 4 00002000:00100000:1.0:1787707371.720518:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8cfa41ca0a80 x1874546707742464/t4294967314(0) o4->9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp:262/0 lens 504/448 e 0 to 0 dl 1787707382 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787707371.720532:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa41ca0a80 with x1874546707742464 ext(0->8) 00002000:00010000:1.0:1787707371.720536:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfa41ca0a80 00000100:00100000:2.0:1787707371.725586:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707371.725626:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707742592 00000100:00100000:2.0:1787707371.725637:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707742592 00000100:00100000:2.0:1787707371.725696:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 183 00000100:00100000:2.0:1787707371.725707:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+22:11547:x1874546707742592:12345-192.168.204.46@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1787707371.772314:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787707371.837041:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1787707371.837056:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:1.0:1787707371.837073:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:1.0:1787707371.837086:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1787707371.837102:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1787707371.837183:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787707371.838156:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+18:11547:x1874546707742592:12345-192.168.204.46@tcp:44:lhsmtool_posix.0 Request processed in 112442us (112572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707371.838167:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 183 00000100:00100000:3.0:1787707371.838340:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729763072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787707371.838438:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707371.838580:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729763072 00000100:00100000:0.0:1787707371.838588:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729763072 00000100:00100000:0.0:1787707371.838649:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787707371.838658:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729763072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787707371.838808:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787707371.838811:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787707370 00002000:00010000:0.0:1787707371.838814:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787707371.838816:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787707370 -> 1787707370 00002000:00010000:0.0:1787707371.838818:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:1.0:1787707371.838893:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787707371.851822:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707371.852050:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707742720 00000100:00100000:2.0:1787707371.852060:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707742720 00000100:00100000:2.0:1787707371.852106:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 55 00000100:00100000:2.0:1787707371.852118:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+10:2360:x1874546707742720:12345-192.168.204.46@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787707371.854990:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1874546729763072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 16323us (16541us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787707371.855006:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:3.0:1787707371.863112:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfa41c96680/2, rc 0, transno 4294967315 00000100:00100000:3.0:1787707371.863131:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729763072:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1787707371.910394:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:1.0:1787707371.910411:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1787707371.910416:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1787707371.910771:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2360:x1874546707742720:12345-192.168.204.46@tcp:16:lhsmtool_posix.0 Request processed in 58643us (58947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707371.910812:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 55 00000100:00100000:1.0:1787707371.914317:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707371.914416:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707742976 00000100:00100000:0.0:1787707371.914427:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707742976 00000100:00100000:0.0:1787707371.914485:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 184 00000100:00100000:0.0:1787707371.914506:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+18:11547:x1874546707742976:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787707371.914561:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707371.914589:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec155b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f4b expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.914628:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cfa204c6a00) 00010000:00010000:0.0:1787707371.914633:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787707371.914669:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1570 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.914683:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1570 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.914692:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1570 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787707371.914973:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000650e145f reply state 0000000062bd6e3b transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1570 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707371.914983:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787707371.915098:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+19:11547:x1874546707742976:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 Request processed in 604us (791us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1787707371.915106:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 184 00000100:00100000:2.0:1787707371.918728:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00010000:00010000:3.0:1787707371.919024:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1570 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.919037:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1570 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.919045:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1570 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.919051:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707371.919056:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1570 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.919064:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1570 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.919082:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cfa204c6a00) 00010000:00010000:3.0:1787707371.919085:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707371.919090:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1570 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.919096:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1570 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707371.919143:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707743104 00000100:00100000:1.0:1787707371.919153:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707743104 00000100:00100000:1.0:1787707371.919245:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 56 00000100:00100000:1.0:1787707371.919257:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2361:x1874546707743104:12345-192.168.204.46@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787707371.919558:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787707371.919562:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787707370 -> 1787707368 00002000:00010000:1.0:1787707371.919565:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787707366 00002000:00010000:1.0:1787707371.919568:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787707370 -> 1787707368 00002000:00010000:1.0:1787707371.919570:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787707371.919635:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2361:x1874546707743104:12345-192.168.204.46@tcp:2:lhsmtool_posix.0 Request processed in 380us (918us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787707371.919655:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 56 00000100:00100000:3.0:1787707371.921979:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707371.922062:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707743360 00000100:00100000:0.0:1787707371.922071:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707743360 00000100:00100000:0.0:1787707371.922132:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 185 00000100:00100000:0.0:1787707371.922142:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+18:11547:x1874546707743360:12345-192.168.204.46@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787707371.922226:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1577 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.922246:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec153f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f3d expref: 18 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.922269:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1577 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.922311:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec153f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f3d expref: 18 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.922325:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec153f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f3d expref: 18 pid: 12425 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707371.922339:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c13100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874546729763200:192.168.204.46@tcp:104: 00000100:00100000:0.0:1787707371.922472:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0734f900 going to sleep for 11 seconds 00000100:00100000:0.0:1787707371.924941:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c13100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874546729763200:192.168.204.46@tcp:104: 00010000:00010000:0.0:1787707371.924975:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1577 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707371.925694:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707371.925980:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707743488 00000100:00100000:0.0:1787707371.925989:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707743488 00010000:00010000:0.0:1787707371.926027:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec153f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f3d expref: 19 pid: 12425 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707371.926066:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 68 00000100:00100000:0.0:1787707371.926077:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa113ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+19:2361:x1874546707743488:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707371.926093:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707371.926100:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec153f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f3d expref: 19 pid: 12425 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.926132:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec153f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f3d expref: 19 pid: 12425 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.926156:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14e00/0xc5f18d5f94ec153f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f3d expref: 19 pid: 12425 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.926174:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cfa204c6a00) 00010000:00010000:0.0:1787707371.926179:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1577 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.926189:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1577 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.926197:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1577 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.926221:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707371.926279:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa113ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+18:2361:x1874546707743488:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 204us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707371.926288:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 68 00010000:00010000:0.0:1787707371.926345:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1577 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.926352:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1577 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.926419:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1577 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.926437:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1577 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.926443:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1577 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.926449:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707371.926455:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1577 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.926464:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1577 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.926474:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cfa204c6a00) 00010000:00010000:0.0:1787707371.926476:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787707371.926481:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1577 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.926486:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1577 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707371.926540:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+17:11547:x1874546707743360:12345-192.168.204.46@tcp:55:lhsmtool_posix.0 Request processed in 4400us (4574us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787707371.926549:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 185 00000100:00100000:3.0:1787707371.928463:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707371.929342:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707743616 00000100:00100000:2.0:1787707371.929354:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707743616 00000100:00100000:2.0:1787707371.929446:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 57 00000100:00100000:2.0:1787707371.929456:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2362:x1874546707743616:12345-192.168.204.46@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787707371.929518:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cca50419/0xc5f18d5f94ec157e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.929542:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013a3e229/0xc5f18d5f94ec1569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f59 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.929551:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707371.929555:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787707371.929560:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cca50419/0xc5f18d5f94ec157e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.929600:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013a3e229/0xc5f18d5f94ec1569 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f59 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.929616:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013a3e229/0xc5f18d5f94ec1569 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f59 expref: 8 pid: 6689 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707371.929632:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a554700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1874546729763328:192.168.204.46@tcp:104: 00000100:00100000:2.0:1787707371.929713:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787707371.933071:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707371.933208:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707743744 00000100:00100000:3.0:1787707371.933218:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707743744 00010000:00010000:3.0:1787707371.933253:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013a3e229/0xc5f18d5f94ec1569 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f59 expref: 9 pid: 6689 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707371.933310:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 69 00000100:00100000:3.0:1787707371.933320:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a555f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+9:2361:x1874546707743744:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787707371.933335:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707371.933363:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013a3e229/0xc5f18d5f94ec1569 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f59 expref: 9 pid: 6689 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.933406:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013a3e229/0xc5f18d5f94ec1569 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f59 expref: 9 pid: 6689 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.933434:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787707371.933438:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787707371.933444:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cca50419/0xc5f18d5f94ec157e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.933455:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cca50419/0xc5f18d5f94ec157e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.933477:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707371.933545:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a555f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+9:2361:x1874546707743744:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 226us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707371.933553:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 69 00010000:00010000:1.0:1787707371.934486:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013a3e229/0xc5f18d5f94ec1569 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f59 expref: 8 pid: 6689 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707371.934516:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a554700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1874546729763328:192.168.204.46@tcp:104: 00010000:00010000:1.0:1787707371.934539:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cca50419/0xc5f18d5f94ec157e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.934551:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cca50419/0xc5f18d5f94ec157e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.934559:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cca50419/0xc5f18d5f94ec157e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.934589:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cca50419/0xc5f18d5f94ec157e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.934597:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cca50419/0xc5f18d5f94ec157e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.934605:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cca50419/0xc5f18d5f94ec157e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.934612:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b600 already unused, calling callback (ffffffffc1630230) 00010000:00010000:1.0:1787707371.934617:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cca50419/0xc5f18d5f94ec157e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.934638:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cca50419/0xc5f18d5f94ec157e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.934655:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cca50419/0xc5f18d5f94ec157e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.934663:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cca50419/0xc5f18d5f94ec157e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707371.934737:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2362:x1874546707743616:12345-192.168.204.46@tcp:1:lhsmtool_posix.0 Request processed in 5282us (6283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707371.934745:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 57 00000100:00100000:2.0:1787707371.937678:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707371.937787:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707744000 00000100:00100000:3.0:1787707371.937797:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707744000 00000100:00100000:3.0:1787707371.937859:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 186 00000100:00100000:3.0:1787707371.937870:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+17:11547:x1874546707744000:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787707371.937978:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1585 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.937995:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1585 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.938006:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1585 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.938213:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec158c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.938225:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec154d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f44 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.938233:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec158c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.938269:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec154d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f44 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.938284:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec154d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f44 expref: 18 pid: 5856 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707371.938299:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874546729763456:192.168.204.46@tcp:104: 00000100:00100000:3.0:1787707371.938421:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1042a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787707371.940710:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874546729763456:192.168.204.46@tcp:104: 00010000:00010000:2.0:1787707371.940741:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec158c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707371.942511:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707371.942780:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707744128 00000100:00100000:0.0:1787707371.942789:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707744128 00010000:00010000:0.0:1787707371.942827:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec154d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f44 expref: 19 pid: 5856 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707371.942873:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 70 00000100:00100000:0.0:1787707371.942908:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a555500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+19:2361:x1874546707744128:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707371.942924:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707371.942932:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec154d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f44 expref: 19 pid: 5856 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.942947:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec154d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f44 expref: 19 pid: 5856 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.942969:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec154d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f44 expref: 19 pid: 5856 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.942985:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cfa204c6a00) 00010000:00010000:0.0:1787707371.942991:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec158c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.943000:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec158c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.943007:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec158c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.943027:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707371.943086:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a555500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+18:2361:x1874546707744128:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 191us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707371.943093:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 70 00010000:00010000:2.0:1787707371.943721:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec158c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.943732:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec158c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787707371.943988:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1787707371.944141:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1787707371.944187:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1787707371.944267:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a555c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1874546729763584:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787707371.944319:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707371.944350:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b3480 going to sleep for 11 seconds 00000100:00100000:0.0:1787707371.944566:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729763584 00000100:00100000:0.0:1787707371.944573:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729763584 00000100:00100000:0.0:1787707371.944615:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787707371.944623:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8469:x1874546729763584:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787707371.944701:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8469:x1874546729763584:12345-0@lo:1000:mdt00_003.0 Request processed in 79us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707371.944708:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787707371.945016:0:8469:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1787707371.945023:0:8469:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfa41c96680, transno 4294967315 00000100:00100000:2.0:1787707371.945046:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a555c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1874546729763584:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787707371.946618:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1787707371.946701:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a555c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1874546729763712:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787707371.946768:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707371.946800:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707371.947071:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729763712 00000100:00100000:0.0:1787707371.947078:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729763712 00000100:00100000:0.0:1787707371.947120:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787707371.947130:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8469:x1874546729763712:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787707371.947404:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8469:x1874546729763712:12345-0@lo:1000:mdt00_003.0 Request processed in 240us (599us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787707371.947412:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787707371.948058:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a555c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1874546729763712:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787707371.948100:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec158c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.948111:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec158c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.948119:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec158c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.948138:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fda00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707371.948143:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec158c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.948151:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec158c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.948168:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cfa204c6a00) 00010000:00010000:2.0:1787707371.948171:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787707371.948176:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec158c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.948183:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec158c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.948217:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec14c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.948224:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec14c1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.948230:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec14c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.948234:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3a00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707371.948237:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec14c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.948243:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec14c1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.948261:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4e600) 00010000:00010000:2.0:1787707371.948264:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787707371.948267:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec14c1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.948273:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec14c1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.948296:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1593 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.948311:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec14dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f28 expref: 21 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.948320:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1593 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.948355:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec14dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f28 expref: 21 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707371.948559:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec14dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f28 expref: 21 pid: 5858 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707371.948575:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a557800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874546729763840:192.168.204.46@tcp:104: 00000100:00100000:3.0:1787707371.951750:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707371.952432:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787707371.952466:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a557800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874546729763840:192.168.204.46@tcp:104: 00010000:00010000:2.0:1787707371.952502:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1593 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707371.953469:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707744256 00000100:00100000:1.0:1787707371.953479:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707744256 00010000:00010000:1.0:1787707371.953532:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec14dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f28 expref: 22 pid: 5858 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707371.953631:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 71 00000100:00100000:1.0:1787707371.953641:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+22:2362:x1874546707744256:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787707371.953656:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707371.953664:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec14dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f28 expref: 22 pid: 5858 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.953677:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec14dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f28 expref: 22 pid: 5858 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.953717:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec14dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f28 expref: 22 pid: 5858 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.953732:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4e600) 00010000:00010000:1.0:1787707371.953737:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1593 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.953747:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1593 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.953755:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1593 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707371.953791:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707371.953855:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+21:2362:x1874546707744256:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 215us (2114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707371.953863:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 71 00010000:00010000:0.0:1787707371.953926:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1593 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.953935:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1593 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.953947:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1593 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.953953:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1593 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.953960:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1593 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.953965:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871bc00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707371.953970:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1593 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.953978:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1593 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.953996:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4e600) 00010000:00010000:0.0:1787707371.953999:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707371.954003:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1593 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.954009:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1593 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.954021:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1585 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.954028:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1585 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.954034:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1585 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.954039:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707371.954041:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1585 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.954047:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1585 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.954055:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa19f4e600) 00010000:00010000:0.0:1787707371.954057:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787707371.954060:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1585 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707371.954066:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1585 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787707371.954340:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787707371.954345:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787707371.954883:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1787707371.954892:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787707371.954993:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+20:11547:x1874546707744000:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 Request processed in 17122us (17321us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1787707371.955003:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 186 00000020:00080000:0.0:1787707371.955008:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787707371.957936:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707371.958107:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707744512 00000100:00100000:3.0:1787707371.958116:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707744512 00000100:00100000:3.0:1787707371.958166:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 50 00000100:00100000:3.0:1787707371.958188:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa189fc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+20:11547:x1874546707744512:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787707371.958819:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787707371.958935:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1787707371.958977:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec159a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.958993:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec159a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.959007:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec159a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.959016:0:5859:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec159a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.959023:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec159a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.959029:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec159a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.959048:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787707371.959142:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa189fc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+22:11547:x1874546707744512:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 Request processed in 953us (1211us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1787707371.959150:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 50 00000020:00080000:3.0:1787707371.959155:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787707371.959203:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707371.959209:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec159a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.959216:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd400 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707371.959226:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec159a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.959234:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec159a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.959247:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cfa143e4c00) 00010000:00010000:3.0:1787707371.959250:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787707371.959253:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec159a lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.959260:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec159a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707371.959278:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707371.959281:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707371.959282:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707372.793404:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707372.856592:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787707372.856614:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729763968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787707372.856684:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707372.856793:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729763968 00000100:00100000:2.0:1787707372.856803:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729763968 00000100:00100000:2.0:1787707372.856869:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787707372.856879:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874546729763968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787707372.856906:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787707372.856953:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874546729763968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707372.856962:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787707372.857113:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729763968:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787707373.494701:0:12517:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787707373.494711:0:12517:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787707373.494750:0:12517:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787707373.494756:0:12517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787707373.584602:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707373.585791:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707744768 00000100:00100000:1.0:1787707373.585805:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707744768 00000100:00100000:1.0:1787707373.585884:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 187 00000100:00100000:1.0:1787707373.585904:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+22:11565:x1874546707744768:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:1.0:1787707373.585928:0:12425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707373.585951:0:12425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec15a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f60 expref: -99 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.586217:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15c00/0xc5f18d5f94ec15a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.586238:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15c00/0xc5f18d5f94ec15a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.586252:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15c00/0xc5f18d5f94ec15a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707373.586263:0:12425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787707373.586473:0:12425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec15a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f60 expref: 25 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.586490:0:12425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15c00/0xc5f18d5f94ec15a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f60 expref: 24 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.586499:0:12425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:1.0:1787707373.586502:0:12425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787707373.586505:0:12425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a15c00, rc 0) 00000100:00100000:1.0:1787707373.586574:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+24:11565:x1874546707744768:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 679us (1981us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1787707373.586581:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 187 00000100:00100000:0.0:1787707373.590168:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00080000:2.0:1787707373.593250:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707373.593670:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707744896 00000100:00100000:3.0:1787707373.593683:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707744896 00000100:00100000:3.0:1787707373.593754:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 188 00000100:00100000:3.0:1787707373.593765:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+24:11565:x1874546707744896:12345-192.168.204.46@tcp:34:lfs.0 00010000:00010000:3.0:1787707373.593850:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec15b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.593868:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec15b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.593880:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec15b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.593895:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec15bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.593917:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec15bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.593923:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec15bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594223:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec15c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594233:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec15c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594241:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec15c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787707373.594291:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec15c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594305:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec15b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594312:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec15b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594319:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec15b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594326:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707373.594331:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec15b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594339:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec15b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594359:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:3.0:1787707373.594363:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707373.594396:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec15b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594404:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec15b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594417:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec15bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594424:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec15bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594431:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec15bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594436:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707373.594439:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec15bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594445:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec15bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594453:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cfa143e4c00) 00010000:00010000:3.0:1787707373.594456:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707373.594470:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec15bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594477:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec15bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594505:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec15c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594512:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec15c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594518:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec15c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594523:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fca00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707373.594526:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec15c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594532:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec15c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594541:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa143e4b00) 00010000:00010000:3.0:1787707373.594543:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707373.594546:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec15c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.594552:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec15c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707373.594641:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+24:11565:x1874546707744896:12345-192.168.204.46@tcp:34:lfs.0 Request processed in 876us (4483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707373.594650:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 188 00000100:00100000:1.0:1787707373.651989:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707373.652084:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707745152 00000100:00100000:2.0:1787707373.652094:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707745152 00000100:00100000:2.0:1787707373.652168:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 189 00000100:00100000:2.0:1787707373.652179:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+24:11568:x1874546707745152:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:2.0:1787707373.652201:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707373.652223:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec15cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f67 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652299:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec15d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652314:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec15d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652339:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec15d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652356:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652363:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652394:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652730:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec15e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652738:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec15e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652745:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec15e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707373.652754:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787707373.652853:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec15d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652860:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec15d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652868:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec15d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652873:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871aa00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707373.652884:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec15d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652891:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec15d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652904:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:2.0:1787707373.652908:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707373.652912:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec15d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652919:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec15d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652932:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652938:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652944:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652949:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707373.652952:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652957:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652965:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cfa12a49400) 00010000:00010000:2.0:1787707373.652967:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707373.652976:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.652982:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.653028:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec15cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f67 expref: 27 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.653042:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec15e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f67 expref: 26 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.653049:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa12a49a00) 00010000:00010000:2.0:1787707373.653052:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787707373.653054:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871ba00, rc 0) 00000100:00100000:2.0:1787707373.653126:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+26:11568:x1874546707745152:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 947us (1147us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1787707373.653133:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 189 00000100:00100000:0.0:1787707373.658867:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707373.658925:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707745280 00000100:00100000:0.0:1787707373.658939:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707745280 00000100:00100000:0.0:1787707373.659001:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 190 00000100:00100000:0.0:1787707373.659013:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+26:11568:x1874546707745280:12345-192.168.204.46@tcp:54:lfs.0 00010000:00010000:0.0:1787707373.659092:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec15ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.659113:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec15ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.659126:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec15ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.659174:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec15ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.659181:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec15ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.659187:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec15ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.659192:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707373.659197:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec15ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.659204:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec15ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.659217:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa12a49a00) 00010000:00010000:0.0:1787707373.659220:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787707373.659224:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec15ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.659230:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec15ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707373.667615:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+26:11568:x1874546707745280:12345-192.168.204.46@tcp:54:lfs.0 Request processed in 8592us (8747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707373.667631:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 190 00000100:00100000:0.0:1787707373.674817:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707373.674901:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707745536 00000100:00100000:3.0:1787707373.674917:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707745536 00000100:00100000:3.0:1787707373.674997:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 51 00000100:00100000:3.0:1787707373.675021:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+26:11568:x1874546707745536:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:3.0:1787707373.675309:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+27:11568:x1874546707745536:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 289us (503us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787707373.675318:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 51 00000100:00100000:1.0:1787707373.704203:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707373.704398:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707745792 00000100:00100000:2.0:1787707373.704409:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707745792 00000100:00100000:2.0:1787707373.704476:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 191 00000100:00100000:2.0:1787707373.704486:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+27:11094:x1874546707745792:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:2.0:1787707373.704511:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707373.704532:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec15f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f6e expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.704640:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.704665:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec15e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f67 expref: 28 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.704675:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15fc lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.704707:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec15e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f67 expref: 28 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.704721:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec15e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f67 expref: 28 pid: 8469 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707373.704736:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a556300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874546729764096:192.168.204.46@tcp:104: 00000100:00100000:2.0:1787707373.704845:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707373.712472:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a556300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874546729764096:192.168.204.46@tcp:104: 00010000:00010000:0.0:1787707373.712502:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707373.712667:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707373.712725:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707745920 00000100:00100000:0.0:1787707373.712731:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707745920 00010000:00010000:0.0:1787707373.712764:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec15e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f67 expref: 29 pid: 8469 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707373.712798:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 72 00000100:00100000:0.0:1787707373.712806:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+29:2361:x1874546707745920:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707373.712819:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707373.712826:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec15e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f67 expref: 29 pid: 8469 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.712839:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec15e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f67 expref: 29 pid: 8469 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.712860:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ba00/0xc5f18d5f94ec15e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f67 expref: 29 pid: 8469 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.712876:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa12a49a00) 00010000:00010000:0.0:1787707373.712880:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.712889:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.712905:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15fc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.712926:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707373.712980:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+28:2361:x1874546707745920:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 174us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707373.712988:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 72 00010000:00010000:0.0:1787707373.713009:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.713016:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707373.713034:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787707373.713196:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec15f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f6e expref: 29 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.713210:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f6e expref: 28 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.713217:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa12a49a00) 00010000:00010000:0.0:1787707373.713220:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787707373.713222:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871b600, rc 0) 00000100:00100000:0.0:1787707373.713243:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+28:11094:x1874546707745792:12345-192.168.204.46@tcp:101:bash.0 Request processed in 8760us (9054us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787707373.713250:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 191 00000100:00100000:1.0:1787707373.723853:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707373.724706:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707746176 00000100:00100000:3.0:1787707373.724717:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707746176 00000100:00100000:3.0:1787707373.724782:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 192 00000100:00100000:3.0:1787707373.724895:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+28:11094:x1874546707746176:12345-192.168.204.46@tcp:36:bash.0 00010000:00010000:3.0:1787707373.725263:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec160a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.725282:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec160a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.725294:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec160a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787707373.725633:0:12425:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1787707373.725668:0:12425:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b45c72f6 reply state 0000000032c88359 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec160a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707373.725678:0:12425:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787707373.725758:0:12425:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1787707373.726048:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+32:11094:x1874546707746176:12345-192.168.204.46@tcp:36:bash.0 Request processed in 1254us (2204us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1787707373.726056:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 192 00000020:00080000:3.0:1787707373.726062:0:12425:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787707373.727767:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec160a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.727797:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec160a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.727806:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec160a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.727812:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707373.727816:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec160a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.727824:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec160a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.727841:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa12a49a00) 00010000:00010000:3.0:1787707373.727844:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707373.727848:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec160a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.727854:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec160a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707373.728650:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707373.728990:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707746304 00000100:00100000:2.0:1787707373.729003:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707746304 00000100:00100000:2.0:1787707373.729065:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 193 00000100:00100000:2.0:1787707373.729078:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+31:11094:x1874546707746304:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:2.0:1787707373.729104:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707373.729126:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1611 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f75 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.729198:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1611 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f75 expref: 32 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.729214:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1611 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f75 expref: 32 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707373.729253:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa12a49a00) 00010000:00010000:2.0:1787707373.729257:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787707373.729260:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871be00, rc 0) 00000100:00100000:2.0:1787707373.729422:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+32:11094:x1874546707746304:12345-192.168.204.46@tcp:101:bash.0 Request processed in 348us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707373.729429:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 193 00000100:00100000:3.0:1787707373.735039:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707373.735075:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707746432 00000100:00100000:3.0:1787707373.735085:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707746432 00000100:00100000:3.0:1787707373.735142:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 58 00000100:00100000:3.0:1787707373.735153:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+7:11094:x1874546707746432:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:3.0:1787707373.735172:0:8265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707373.735192:0:8265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1618 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f7c expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787707373.735227:0:8265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8e3fe8, atime: 0x6a8e3fe6, ctime: 0x6a8e3fe8, blocks: 0xb 00010000:00010000:3.0:1787707373.735248:0:8265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=424s v=(0 0) 00010000:00010000:3.0:1787707373.735253:0:8265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707373.735260:0:8265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1618 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f7c expref: 8 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.735278:0:8265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1618 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f7c expref: 8 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.735291:0:8265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fca00, rc 0) 00000100:00100000:3.0:1787707373.735621:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+8:11094:x1874546707746432:12345-192.168.204.46@tcp:101:bash.0 Request processed in 468us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707373.735628:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 58 00000100:00080000:3.0:1787707373.735651:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787707373.739176:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707373.740019:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707746560 00000100:00100000:1.0:1787707373.740033:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707746560 00002000:00010000:1.0:1787707373.740086:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1787707373.740091:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa3a556d80 with x1874546707746560 ext(0->18446744073709551615) 00002000:00010000:1.0:1787707373.740105:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfa3a556d80. 00000100:00100000:1.0:1787707373.740140:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 5 00000100:00100000:1.0:1787707373.740160:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2361:x1874546707746560:12345-192.168.204.46@tcp:10:bash.0 00002000:00010000:1.0:1787707373.740480:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787707373.740483:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787707368 -> 1787707372 00002000:00010000:1.0:1787707373.740486:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787707366 -> 1787707366 00002000:00010000:1.0:1787707373.740488:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787707368 -> 1787707372 00002000:00010000:1.0:1787707373.740490:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787707373.740557:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+9:2361:x1874546707746560:12345-192.168.204.46@tcp:10:bash.0 Request processed in 399us (1393us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787707373.740566:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 5 00002000:00010000:1.0:1787707373.740570:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1787707373.740572:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa3a556d80 with x1874546707746560 ext(0->18446744073709551615) 00002000:00010000:1.0:1787707373.740577:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfa3a556d80. 00000100:00100000:3.0:1787707373.794077:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707373.794403:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707746688 00000100:00100000:0.0:1787707373.794414:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707746688 00000100:00100000:0.0:1787707373.794482:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 194 00000100:00100000:0.0:1787707373.794493:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+32:11582:x1874546707746688:12345-192.168.204.46@tcp:34:lfs.0 00010000:00010000:0.0:1787707373.794576:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec161f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.794613:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec161f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.794626:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec161f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.794643:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1626 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.794650:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1626 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.794656:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1626 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795096:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec162d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795106:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec162d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795114:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec162d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787707373.795162:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec162d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795175:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec161f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795181:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec161f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795199:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec161f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795206:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707373.795209:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec161f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795218:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec161f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795231:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:0.0:1787707373.795235:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707373.795240:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec161f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795246:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec161f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795261:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1626 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795345:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1626 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795352:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1626 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795357:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707373.795360:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1626 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795432:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1626 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795442:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cfa19f4e600) 00010000:00010000:0.0:1787707373.795444:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707373.795447:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1626 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795453:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1626 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795479:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec162d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795486:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec162d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795491:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec162d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795496:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707373.795498:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec162d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795653:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec162d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795662:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa12a49a00) 00010000:00010000:0.0:1787707373.795664:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707373.795667:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec162d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.795683:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec162d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707373.795815:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+32:11582:x1874546707746688:12345-192.168.204.46@tcp:34:lfs.0 Request processed in 1319us (1742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707373.795824:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 194 00010000:00010000:1.0:1787707373.816776:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707373.836670:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707373.836843:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707746944 00000100:00100000:1.0:1787707373.836859:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707746944 00000100:00100000:1.0:1787707373.836956:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 195 00000100:00100000:1.0:1787707373.836970:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+32:11585:x1874546707746944:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:1.0:1787707373.836996:0:12425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707373.837023:0:12425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec1634 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f83 expref: -99 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.837111:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec163b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.837127:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec163b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.837139:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec163b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.837174:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1642 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.837182:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.837190:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.838216:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1649 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.838229:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.838238:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707373.838249:0:12425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787707373.838742:0:12425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec163b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.838752:0:12425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec163b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.838758:0:12425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec163b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.838764:0:12425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14c00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707373.838768:0:12425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec163b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.838776:0:12425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec163b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.838801:0:12425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:0.0:1787707373.838804:0:12425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707373.838809:0:12425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec163b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.838815:0:12425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec163b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.838828:0:12425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.838833:0:12425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1642 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.838838:0:12425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1642 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.838842:0:12425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707373.838845:0:12425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1642 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.838850:0:12425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1642 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.838857:0:12425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cfa204c6b00) 00010000:00010000:0.0:1787707373.838859:0:12425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787707373.838862:0:12425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1642 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.838868:0:12425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1642 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.839610:0:12425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec1634 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f83 expref: 35 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.839629:0:12425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1649 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f83 expref: 34 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.839638:0:12425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa12a49a00) 00010000:00010000:0.0:1787707373.839640:0:12425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787707373.839643:0:12425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3200, rc 0) 00000100:00100000:0.0:1787707373.839741:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+34:11585:x1874546707746944:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 2772us (3083us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1787707373.839751:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 195 00000100:00100000:2.0:1787707373.845440:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707373.845530:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707747072 00000100:00100000:3.0:1787707373.845542:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707747072 00000100:00100000:3.0:1787707373.845611:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 196 00000100:00100000:3.0:1787707373.845624:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+34:11585:x1874546707747072:12345-192.168.204.46@tcp:54:lfs.0 00010000:00010000:3.0:1787707373.845704:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1657 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.845726:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15fc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f6e expref: 34 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.845756:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1657 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.845807:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f6e expref: 34 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.845824:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f6e expref: 34 pid: 5856 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707373.845841:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874546729764224:192.168.204.46@tcp:104: 00000100:00100000:3.0:1787707373.845954:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41fe2240 going to sleep for 11 seconds 00000100:00100000:3.0:1787707373.847959:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707373.848137:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874546729764224:192.168.204.46@tcp:104: 00010000:00010000:0.0:1787707373.848164:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1657 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707373.848219:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707747328 00000100:00100000:1.0:1787707373.848227:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707747328 00000100:00100000:1.0:1787707373.848358:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 52 00000100:00100000:1.0:1787707373.848412:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+35:5599:x1874546707747328:12345-192.168.204.46@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787707373.848852:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+36:5599:x1874546707747328:12345-192.168.204.46@tcp:35:ldlm_bl.0 Request processed in 483us (903us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1787707373.848861:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 52 00000100:00100000:0.0:1787707373.851153:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707373.851423:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707747456 00000100:00100000:3.0:1787707373.851435:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707747456 00010000:00010000:3.0:1787707373.851487:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f6e expref: 36 pid: 5856 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707373.851535:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 73 00000100:00100000:3.0:1787707373.851546:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+36:2361:x1874546707747456:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787707373.851565:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707373.851575:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f6e expref: 36 pid: 5856 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.851589:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f6e expref: 36 pid: 5856 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.851638:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec15fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f6e expref: 36 pid: 5856 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.851658:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa12a49a00) 00010000:00010000:3.0:1787707373.851663:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1657 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.851673:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.851681:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1657 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707373.851708:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707373.851775:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+35:2361:x1874546707747456:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 231us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707373.851782:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 73 00010000:00010000:0.0:1787707373.851851:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.851859:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.851896:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.851903:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1657 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.851919:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1657 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.851926:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707373.851931:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1657 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.851940:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1657 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.851950:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa12a49a00) 00010000:00010000:0.0:1787707373.851953:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787707373.851957:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1657 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707373.851962:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1657 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707373.852019:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+34:11585:x1874546707747072:12345-192.168.204.46@tcp:54:lfs.0 Request processed in 6398us (6590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707373.852028:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 196 00000100:00100000:0.0:1787707373.854436:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707373.854526:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707747712 00000100:00100000:1.0:1787707373.854537:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707747712 00000100:00100000:1.0:1787707373.854593:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 53 00000100:00100000:1.0:1787707373.854604:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+34:11585:x1874546707747712:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:1.0:1787707373.854865:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+35:11585:x1874546707747712:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 262us (438us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1787707373.854873:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 53 00000100:00100000:2.0:1787707373.973308:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707373.973688:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707747968 00000100:00100000:1.0:1787707373.973699:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707747968 00000100:00100000:1.0:1787707373.973762:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 197 00000100:00100000:1.0:1787707373.973773:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+35:11596:x1874546707747968:12345-192.168.204.46@tcp:101:cat.0 00010000:00010000:1.0:1787707373.973826:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707373.973849:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15e00/0xc5f18d5f94ec165e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f8a expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.973939:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec1665 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.973955:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec1665 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.973970:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec1665 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.973987:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec166c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.973994:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec166c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.974001:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec166c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.974737:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec1673 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.974749:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec1673 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.974758:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec1673 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707373.974771:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1787707373.974924:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec1665 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.974932:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec1665 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.974940:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec1665 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.974947:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707373.974953:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec1665 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.974961:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec1665 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.974979:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:1.0:1787707373.974983:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707373.974991:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec1665 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.974997:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14800/0xc5f18d5f94ec1665 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.975014:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec166c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.975020:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec166c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.975026:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec166c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.975031:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707373.975042:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec166c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.975048:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec166c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.975056:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cfa204c6600) 00010000:00010000:1.0:1787707373.975059:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707373.975063:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec166c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.975069:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec166c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.975120:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15e00/0xc5f18d5f94ec165e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f8a expref: 38 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.975134:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec1673 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f8a expref: 37 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707373.975142:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa12a49a00) 00010000:00010000:1.0:1787707373.975144:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787707373.975147:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a14c00, rc 0) 00000100:00100000:1.0:1787707373.975258:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+37:11596:x1874546707747968:12345-192.168.204.46@tcp:101:cat.0 Request processed in 1486us (1964us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1787707373.976547:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 197 00000100:00100000:1.0:1787707373.981354:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707373.981815:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707748224 00000100:00100000:3.0:1787707373.981829:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707748224 00000100:00100000:3.0:1787707373.981899:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 54 00000100:00100000:3.0:1787707373.981910:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+37:11596:x1874546707748224:12345-192.168.204.46@tcp:35:cat.0 00000100:00100000:3.0:1787707373.982840:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+38:11596:x1874546707748224:12345-192.168.204.46@tcp:35:cat.0 Request processed in 926us (1493us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1787707373.982851:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 54 00000100:00100000:0.0:1787707374.005876:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707374.006012:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707748480 00000100:00100000:3.0:1787707374.006025:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707748480 00000100:00100000:3.0:1787707374.006135:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 198 00000100:00100000:3.0:1787707374.006161:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+38:11598:x1874546707748480:12345-192.168.204.46@tcp:36:rm.0 00010000:00010000:3.0:1787707374.006224:0:12425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787707374.006255:0:12425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14c00/0xc5f18d5f94ec1673 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f8a expref: 38 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.006613:0:12425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec1649 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f83 expref: 37 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.006625:0:12425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1611 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f75 expref: 36 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.006634:0:12425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa12a49a00) 00010000:00010000:3.0:1787707374.006647:0:12425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787707374.006671:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1681 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.006684:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1681 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.006692:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1681 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.006710:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1688 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.006717:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1688 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.006723:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1688 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.007162:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec168f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.007171:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec168f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.007179:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec168f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787707374.008204:0:12425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1787707374.008217:0:12425:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 425054845457ns, next at 426054842686ns, rc = 0 00010000:00010000:3.0:1787707374.008758:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1696 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.008774:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1696 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.008783:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1696 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.008802:0:12425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1696 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.008810:0:12425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1696 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.008815:0:12425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1696 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.008843:0:12425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787707374.008870:0:12425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec168f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.008886:0:12425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec168f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.008892:0:12425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec168f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.008898:0:12425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fda00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707374.008904:0:12425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec168f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.008912:0:12425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec168f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.008924:0:12425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa143e4400) 00010000:00010000:3.0:1787707374.008926:0:12425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787707374.008931:0:12425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec168f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.008937:0:12425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec168f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.008957:0:12425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1681 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.008962:0:12425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1681 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.008968:0:12425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1681 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.008973:0:12425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707374.008981:0:12425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1681 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.008987:0:12425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1681 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.008995:0:12425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:3.0:1787707374.008997:0:12425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707374.009000:0:12425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1681 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.009006:0:12425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec1681 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787707374.009016:0:12425:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4014d90 reply state 000000007b4be5c3 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1688 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707374.009026:0:12425:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787707374.009136:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+37:11598:x1874546707748480:12345-192.168.204.46@tcp:36:rm.0 Request processed in 2974us (3272us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1787707374.009146:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 198 00010000:00010000:1.0:1787707374.009490:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787707374.009498:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1696 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.009525:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd600 already unused, calling callback (ffffffffc1630230) 00010000:00010000:1.0:1787707374.009529:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1696 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.009535:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1696 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.009545:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cfa143e4400) 00010000:00010000:1.0:1787707374.009548:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787707374.009551:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1696 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.009556:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec1696 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.009573:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707374.009575:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707374.009577:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707374.018672:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1688 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.018690:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1688 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.018697:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1688 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.018703:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707374.018708:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1688 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.018731:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1688 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.018749:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cfa143e4d00) 00010000:00010000:3.0:1787707374.018752:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707374.018757:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1688 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.018762:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1688 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707374.045631:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707374.045728:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707748736 00000100:00100000:3.0:1787707374.045738:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707748736 00000100:00100000:3.0:1787707374.045858:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 199 00000100:00100000:3.0:1787707374.045870:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+36:11604:x1874546707748736:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:3.0:1787707374.045909:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707374.045933:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec169d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f91 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.046078:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec16a4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.046104:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec16a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.046115:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec16a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.046129:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec16ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.046151:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec16ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.046159:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec16ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787707374.046766:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787707374.046926:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec16b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.046936:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec16b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.046943:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec16b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.046977:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec16a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.046985:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec16a4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.046992:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec16a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.046998:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707374.047002:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec16a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.047010:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec16a4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.047032:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:3.0:1787707374.047035:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707374.047040:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec16a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.047046:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec16a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787707374.047060:0:8469:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000500efdd3 reply state 000000002431d99a transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec16ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707374.047069:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787707374.047097:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec169d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f91 expref: 39 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.047113:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec16b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f91 expref: 38 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.047120:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa143e4200) 00010000:00010000:3.0:1787707374.047122:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787707374.047125:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fd600, rc 0) 00000100:00100000:3.0:1787707374.047205:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+39:11604:x1874546707748736:12345-192.168.204.46@tcp:101:bash.0 Request processed in 1337us (1585us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1787707374.047213:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 199 00010000:00010000:3.0:1787707374.051150:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec16ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.051170:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec16ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.051199:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec16ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.051206:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fda00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707374.051211:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec16ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.051218:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec16ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.051236:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cfa143e4d00) 00010000:00010000:3.0:1787707374.051239:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707374.051243:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec16ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.051248:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec16ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707374.053988:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707374.054207:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707748864 00000100:00100000:1.0:1787707374.054218:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707748864 00000100:00100000:1.0:1787707374.054601:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 59 00000100:00100000:1.0:1787707374.054613:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2362:x1874546707748864:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:1.0:1787707374.054631:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707374.054653:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec16c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f98 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787707374.054680:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787707374.054701:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1787707374.054718:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707374.054730:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec16c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f98 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.054750:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec16c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f98 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.054764:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a14400, rc 0) 00000100:00100000:1.0:1787707374.054848:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2362:x1874546707748864:12345-192.168.204.46@tcp:101:bash.0 Request processed in 238us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707374.054855:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 59 00000100:00080000:3.0:1787707374.056884:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787707374.060794:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707374.060990:0:12022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707748992 00000100:00100000:0.0:1787707374.061001:0:12022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707748992 00000100:00100000:0.0:1787707374.061061:0:12022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 60 00000100:00100000:0.0:1787707374.061071:0:12022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a554000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+6:11604:x1874546707748992:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:0.0:1787707374.061100:0:12022:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707374.061120:0:12022:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec16c7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9f9f expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.061157:0:12022:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec16c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f98 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.061166:0:12022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707374.061170:0:12022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707374.061176:0:12022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec16c7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f9f expref: 7 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.061211:0:12022:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec16c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f98 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.061226:0:12022:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec16c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f98 expref: 7 pid: 6689 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707374.061240:0:12022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12022:1874546729764352:192.168.204.46@tcp:104: 00000100:00100000:0.0:1787707374.063153:0:12022:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0734f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707374.063190:0:12022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12022:1874546729764352:192.168.204.46@tcp:104: 00010000:00010000:0.0:1787707374.063221:0:12022:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec16c7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f9f expref: 7 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.063240:0:12022:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3000, rc 0) 00000100:00100000:0.0:1787707374.063300:0:12022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a554000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+7:11604:x1874546707748992:12345-192.168.204.46@tcp:101:bash.0 Request processed in 2229us (2517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707374.063309:0:12022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 60 00000100:00100000:1.0:1787707374.064717:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707374.064876:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707749120 00000100:00100000:0.0:1787707374.064884:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707749120 00010000:00010000:0.0:1787707374.064918:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec16c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f98 expref: 7 pid: 6689 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707374.064991:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 74 00000100:00100000:0.0:1787707374.065001:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2361:x1874546707749120:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707374.065013:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707374.065037:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec16c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f98 expref: 7 pid: 6689 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.065051:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec16c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f98 expref: 7 pid: 6689 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.065072:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec16c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f98 expref: 7 pid: 6689 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.065089:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707374.065094:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707374.065101:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec16c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f9f expref: 6 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.065112:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec16c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f9f expref: 6 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.065162:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec16c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f9f expref: 6 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707374.065178:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c10700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5843:1874546729764480:192.168.204.46@tcp:105: 00000100:00100000:0.0:1787707374.065254:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0734f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707374.068192:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c10700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5843:1874546729764480:192.168.204.46@tcp:105: 00010000:00010000:0.0:1787707374.068216:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707374.068315:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2361:x1874546707749120:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 3314us (3602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707374.068326:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 74 00000100:00100000:1.0:1787707374.070016:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707374.070091:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707749376 00000100:00100000:3.0:1787707374.070100:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707749376 00000100:00100000:3.0:1787707374.070175:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 55 00000100:00100000:3.0:1787707374.070185:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+38:11604:x1874546707749376:12345-192.168.204.46@tcp:35:bash.0 00000100:00100000:3.0:1787707374.070561:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+39:11604:x1874546707749376:12345-192.168.204.46@tcp:35:bash.0 Request processed in 376us (549us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787707374.070568:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 55 00000100:00100000:1.0:1787707374.258993:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707374.260144:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707749504 00000100:00100000:0.0:1787707374.260157:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707749504 00000100:00100000:0.0:1787707374.260239:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 200 00000100:00100000:0.0:1787707374.260251:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+39:11620:x1874546707749504:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:0.0:1787707374.260281:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707374.260306:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec16ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9fa6 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.260418:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec16d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.260433:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec16d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.260444:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec16d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707374.260546:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787707374.260550:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787707374.260573:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec16d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.260598:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec16ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fa6 expref: 41 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.260617:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec16d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fa6 expref: 40 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.260626:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:0.0:1787707374.260628:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787707374.260631:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3200, rc 0) 00000100:00100000:0.0:1787707374.260699:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+40:11620:x1874546707749504:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 450us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707374.260707:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 200 00000100:00100000:2.0:1787707374.270716:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707374.270887:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707749760 00000100:00100000:3.0:1787707374.270898:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707749760 00000100:00100000:3.0:1787707374.270971:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 201 00000100:00100000:3.0:1787707374.270981:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+40:11620:x1874546707749760:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:3.0:1787707374.271001:0:12425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707374.271027:0:12425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec16dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9fad expref: -99 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.271150:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec16e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.271166:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec16e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.271178:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec16e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707374.271188:0:12425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787707374.271310:0:12425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fda00/0xc5f18d5f94ec16dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fad expref: 43 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.271331:0:12425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec16e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fad expref: 42 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.271340:0:12425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa143e4200) 00010000:00010000:3.0:1787707374.271343:0:12425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787707374.271346:0:12425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fd400, rc 0) 00000100:00100000:3.0:1787707374.271472:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+42:11620:x1874546707749760:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 492us (765us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1787707374.271479:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 201 00000100:00100000:1.0:1787707374.275742:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707374.275840:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707374.275949:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707750016 00000100:00100000:3.0:1787707374.275969:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707750016 00000100:00100000:3.0:1787707374.276036:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 202 00000100:00100000:3.0:1787707374.276047:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+42:11620:x1874546707750016:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:3.0:1787707374.276073:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707374.276096:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec16f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9fb4 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.276194:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec16f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.276209:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec16f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.276220:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec16f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707374.276230:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787707374.276415:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc600/0xc5f18d5f94ec16f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fb4 expref: 45 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.276433:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec16f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fb4 expref: 44 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.276442:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa143e4200) 00010000:00010000:3.0:1787707374.276454:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787707374.276459:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa00031c00, rc 0) 00000100:00100000:3.0:1787707374.276530:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+44:11620:x1874546707750016:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 484us (797us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787707374.276537:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 202 00000100:00100000:2.0:1787707374.276930:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707750144 00000100:00100000:2.0:1787707374.276937:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707750144 00000100:00100000:2.0:1787707374.276974:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 15 00000100:00100000:2.0:1787707374.276983:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa113ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+44:2360:x1874546707750144:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787707374.276994:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707374.277011:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec16e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fad expref: 44 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.277023:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa143e4200) 00010000:00010000:2.0:1787707374.277027:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707374.277113:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa113ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+43:2360:x1874546707750144:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 131us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707374.277120:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 15 00000100:00100000:1.0:1787707374.286709:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707374.286799:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707750272 00000100:00100000:3.0:1787707374.286809:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707750272 00000100:00100000:3.0:1787707374.286870:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 61 00000100:00100000:3.0:1787707374.286881:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+6:2361:x1874546707750272:12345-192.168.204.46@tcp:1:lfs.0 00010000:00010000:3.0:1787707374.286938:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095f124f8/0xc5f18d5f94ec1706 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.286961:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec16c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f9f expref: 6 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.286968:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707374.286972:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787707374.286976:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095f124f8/0xc5f18d5f94ec1706 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.287011:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec16c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f9f expref: 6 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.287025:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec16c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f9f expref: 6 pid: 12022 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707374.287040:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1874546729764608:192.168.204.46@tcp:104: 00000100:00100000:3.0:1787707374.287147:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41fe2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707374.291432:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707374.291501:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707750400 00000100:00100000:1.0:1787707374.291510:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707750400 00002000:00100000:1.0:1787707374.291568:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8cfa34c10700 x1874546707750400/t0(0) o4->9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp:265/0 lens 504/0 e 0 to 0 dl 1787707385 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787707374.291580:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa34c10700 with x1874546707750400 ext(0->8) 00010000:00010000:1.0:1787707374.291590:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec16c7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f9f expref: 7 pid: 12022 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.291609:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec16c7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f9f expref: 7 pid: 12022 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787707374.291635:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cfa34c10700 00000100:00100000:1.0:1787707374.291674:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 3 00000100:00100000:1.0:1787707374.291684:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2362:x1874546707750400:12345-192.168.204.46@tcp:4:lfs.0 00000100:00100000:1.0:1787707374.292143:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+9:2362:x1874546707750400:12345-192.168.204.46@tcp:4:lfs.0 Request processed in 458us (718us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787707374.292151:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 3 00002000:00100000:1.0:1787707374.292159:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8cfa34c10700 x1874546707750400/t4294967308(0) o4->9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp:265/0 lens 504/448 e 0 to 0 dl 1787707385 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787707374.292167:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa34c10700 with x1874546707750400 ext(0->8) 00010000:00010000:1.0:1787707374.292173:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec16c7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f9f expref: 9 pid: 12022 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.292185:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec16c7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f9f expref: 9 pid: 12022 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787707374.292191:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cfa34c10700 00000100:00100000:3.0:1787707374.292210:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1874546729764608:192.168.204.46@tcp:104: 00010000:00010000:3.0:1787707374.292236:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000095f124f8/0xc5f18d5f94ec1706 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707374.302955:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707374.303110:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707750528 00000100:00100000:3.0:1787707374.303121:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707750528 00010000:00010000:3.0:1787707374.303162:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec16c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f9f expref: 9 pid: 12022 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707374.303249:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 75 00000100:00100000:3.0:1787707374.303260:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+9:2361:x1874546707750528:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787707374.303276:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787707374.303296:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787707374.303299:0:8450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787707372 00002000:00010000:3.0:1787707374.303302:0:8450:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787707373 00002000:00010000:3.0:1787707374.303304:0:8450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787707372 00010000:00010000:3.0:1787707374.303311:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec16c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f9f expref: 9 pid: 12022 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.303327:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec16c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f9f expref: 9 pid: 12022 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.303349:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec16c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f9f expref: 9 pid: 12022 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.303368:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787707374.303427:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787707374.303434:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000095f124f8/0xc5f18d5f94ec1706 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.303471:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095f124f8/0xc5f18d5f94ec1706 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.303511:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787707374.303545:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000095f124f8/0xc5f18d5f94ec1706 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.303555:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095f124f8/0xc5f18d5f94ec1706 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707374.303573:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2361:x1874546707750528:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 315us (632us total) trans 0 rc 0/0 00010000:00010000:1.0:1787707374.303578:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095f124f8/0xc5f18d5f94ec1706 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707374.303581:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 75 00010000:00010000:1.0:1787707374.303591:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095f124f8/0xc5f18d5f94ec1706 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.303599:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095f124f8/0xc5f18d5f94ec1706 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.303607:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa00031200 already unused, calling callback (ffffffffc1630230) 00010000:00010000:1.0:1787707374.303611:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095f124f8/0xc5f18d5f94ec1706 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.303621:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095f124f8/0xc5f18d5f94ec1706 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.303632:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095f124f8/0xc5f18d5f94ec1706 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.303639:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095f124f8/0xc5f18d5f94ec1706 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707374.303686:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2361:x1874546707750272:12345-192.168.204.46@tcp:1:lfs.0 Request processed in 16807us (16987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707374.303693:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 61 00000100:00100000:0.0:1787707374.311935:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707374.312075:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707750784 00000100:00100000:2.0:1787707374.312116:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707750784 00000100:00100000:2.0:1787707374.312181:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 56 00000100:00100000:2.0:1787707374.312192:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa189f8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+43:11620:x1874546707750784:12345-192.168.204.46@tcp:35:lfs.0 00000004:00010000:2.0:1787707374.312270:0:5860:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec16f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fb4 expref: 43 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787707374.312973:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1787707374.313019:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1787707374.313351:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1787707374.313427:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec170d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.313456:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec16b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f91 expref: 47 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.313467:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec170d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.313984:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec16b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f91 expref: 47 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.314002:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec16b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f91 expref: 47 pid: 8469 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707374.314019:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a555f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874546729764736:192.168.204.46@tcp:104: 00000100:00100000:2.0:1787707374.314126:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073bc600 going to sleep for 11 seconds 00000100:00100000:2.0:1787707374.317290:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707374.317616:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a555f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874546729764736:192.168.204.46@tcp:104: 00010000:00010000:0.0:1787707374.317647:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec170d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707374.325977:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707750912 00000100:00100000:1.0:1787707374.325997:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707750912 00010000:00010000:1.0:1787707374.326070:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec16b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f91 expref: 48 pid: 8469 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707374.326556:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 76 00000100:00100000:1.0:1787707374.326568:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a555500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+48:2362:x1874546707750912:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787707374.326586:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707374.326594:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec16b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f91 expref: 48 pid: 8469 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.326609:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec16b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f91 expref: 48 pid: 8469 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.326633:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd600/0xc5f18d5f94ec16b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f91 expref: 48 pid: 8469 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.326650:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa143e4200) 00010000:00010000:1.0:1787707374.326655:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec170d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.326664:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec170d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.326671:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec170d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.326704:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787707374.326846:0:5860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec170d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.326854:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec170d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787707374.326994:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787707374.327225:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1787707374.327336:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c13b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874546729764864:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787707374.327439:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707374.327476:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2a583f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787707374.327499:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729764864 00000100:00100000:0.0:1787707374.327505:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729764864 00000100:00100000:0.0:1787707374.327549:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787707374.327557:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5860:x1874546729764864:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787707374.327624:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5860:x1874546729764864:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 67us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707374.327631:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787707374.327650:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787707374.327675:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c13b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874546729764864:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787707374.328077:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1787707374.328127:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c13b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874546729764992:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787707374.328154:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707374.328170:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2a583d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787707374.328182:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729764992 00000100:00100000:0.0:1787707374.328185:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729764992 00000100:00100000:0.0:1787707374.328204:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787707374.328210:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5860:x1874546729764992:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787707374.328331:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5860:x1874546729764992:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 121us (175us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787707374.328339:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787707374.328401:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c13b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874546729764992:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787707374.328436:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1787707374.328486:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec170d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.328495:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec170d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.328503:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec170d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.328509:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871ae00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707374.328514:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec170d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.328520:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec170d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.328536:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa143e4200) 00010000:00010000:0.0:1787707374.328540:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787707374.328545:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec170d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.328552:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871ae00/0xc5f18d5f94ec170d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787707374.328714:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787707374.328817:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1787707374.328828:0:5860:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 425375457202ns, next at 426375454929ns, rc = 0 00000001:00080000:0.0:1787707374.328834:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1787707374.328864:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa143e4200) 00010000:00010000:0.0:1787707374.328873:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787707374.328881:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec16f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fb4 expref: 52 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707374.329051:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a555500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+51:2362:x1874546707750912:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 2484us (11769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707374.329062:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 76 00000100:00100000:0.0:1787707374.330001:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa189f8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+50:11620:x1874546707750784:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 17807us (18075us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1787707374.330013:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 56 00000020:00080000:0.0:1787707374.330018:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787707374.336581:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707374.338180:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707751040 00000100:00100000:2.0:1787707374.338196:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707751040 00000100:00100000:2.0:1787707374.338280:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 203 00000100:00100000:2.0:1787707374.338292:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+50:11620:x1874546707751040:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:2.0:1787707374.338319:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707374.338347:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec1714 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9fbb expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.338442:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec1714 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fbb expref: 51 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.338469:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec1714 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fbb expref: 51 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.338493:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:2.0:1787707374.338496:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787707374.338500:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871aa00, rc 0) 00000100:00100000:2.0:1787707374.338580:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+51:11620:x1874546707751040:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 291us (2010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707374.338588:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 203 00000100:00100000:2.0:1787707374.349533:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707374.349674:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707751296 00000100:00100000:3.0:1787707374.349686:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707751296 00000100:00100000:3.0:1787707374.349741:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 57 00000100:00100000:3.0:1787707374.349753:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+51:11620:x1874546707751296:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:3.0:1787707374.350013:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+52:11620:x1874546707751296:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 262us (493us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1787707374.350020:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 57 00000100:00100000:0.0:1787707374.434504:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707374.434653:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707751424 00000100:00100000:2.0:1787707374.434664:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707751424 00000100:00100000:2.0:1787707374.434729:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 204 00000100:00100000:2.0:1787707374.434740:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+52:11630:x1874546707751424:12345-192.168.204.46@tcp:34:lfs.0 00010000:00010000:2.0:1787707374.434828:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec171b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.434847:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec171b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.434878:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec171b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.434894:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1722 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.434912:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.434919:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435011:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1729 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435019:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435025:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787707374.435064:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435076:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec171b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435083:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec171b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435089:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec171b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435105:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871be00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707374.435109:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec171b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435117:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec171b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435130:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:2.0:1787707374.435133:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707374.435138:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec171b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435144:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec171b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435158:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435164:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1722 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435170:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435175:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871bc00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707374.435177:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435183:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1722 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435200:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cfa12a49a00) 00010000:00010000:2.0:1787707374.435202:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707374.435206:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1722 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435211:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1722 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435226:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435232:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1729 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435238:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1729 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435243:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871a600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707374.435246:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1729 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435251:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1729 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435258:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:2.0:1787707374.435261:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707374.435264:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1729 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.435269:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1729 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707374.435358:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+52:11630:x1874546707751424:12345-192.168.204.46@tcp:34:lfs.0 Request processed in 618us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707374.435366:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 204 00000100:00100000:2.0:1787707374.478869:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707374.479012:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707751680 00000100:00100000:3.0:1787707374.479023:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707751680 00000100:00100000:3.0:1787707374.479085:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 205 00000100:00100000:3.0:1787707374.479096:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+52:11633:x1874546707751680:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:3.0:1787707374.479119:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707374.479143:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1730 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9fc2 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479250:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec1737 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479276:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec1737 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479287:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec1737 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479304:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec173e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479311:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec173e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479317:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec173e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479513:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec1745 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479522:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec1745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479528:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec1745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707374.479538:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787707374.479639:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec1737 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479646:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec1737 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479653:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec1737 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479665:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa00030600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707374.479670:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec1737 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479677:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec1737 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479690:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:3.0:1787707374.479692:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707374.479697:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec1737 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479702:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec1737 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479715:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec173e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479722:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec173e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479728:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec173e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479732:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa00031c00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707374.479735:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec173e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479740:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec173e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479758:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cfa143e4d00) 00010000:00010000:3.0:1787707374.479761:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707374.479763:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec173e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479769:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec173e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479808:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1730 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fc2 expref: 55 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479822:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec1745 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fc2 expref: 54 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.479830:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:3.0:1787707374.479832:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787707374.479834:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa00031200, rc 0) 00000100:00100000:3.0:1787707374.479909:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+54:11633:x1874546707751680:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 814us (1049us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1787707374.479917:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 205 00000100:00100000:3.0:1787707374.483809:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707374.483919:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707751808 00000100:00100000:0.0:1787707374.483928:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707751808 00000100:00100000:0.0:1787707374.483997:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 206 00000100:00100000:0.0:1787707374.484009:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+54:11633:x1874546707751808:12345-192.168.204.46@tcp:54:lfs.0 00010000:00010000:0.0:1787707374.484082:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1753 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.484099:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.484110:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.484137:0:12425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.484143:0:12425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1753 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.484149:0:12425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1753 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.484169:0:12425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707374.484174:0:12425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1753 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.484182:0:12425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1753 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.484195:0:12425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:0.0:1787707374.484198:0:12425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787707374.484203:0:12425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1753 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.484209:0:12425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec1753 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707374.484289:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+54:11633:x1874546707751808:12345-192.168.204.46@tcp:54:lfs.0 Request processed in 281us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707374.484297:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 206 00000100:00100000:0.0:1787707374.487594:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707374.487676:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707752064 00000100:00100000:3.0:1787707374.487685:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707752064 00000100:00100000:3.0:1787707374.487740:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 58 00000100:00100000:3.0:1787707374.487750:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+54:11633:x1874546707752064:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:3.0:1787707374.488005:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+55:11633:x1874546707752064:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 257us (421us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787707374.488031:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 58 00000100:00100000:2.0:1787707374.554577:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707374.554700:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707752320 00000100:00100000:0.0:1787707374.554711:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707752320 00000100:00100000:0.0:1787707374.554778:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 207 00000100:00100000:0.0:1787707374.554798:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+55:11643:x1874546707752320:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:0.0:1787707374.554827:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707374.554830:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787707374.554862:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec16d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fa6 expref: 55 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.554903:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:0.0:1787707374.554909:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787707374.554925:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec175a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9fc9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.555038:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1761 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.555053:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec1745 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fc2 expref: 55 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.555060:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1761 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.555106:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec1745 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fc2 expref: 55 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.555121:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec1745 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fc2 expref: 55 pid: 8469 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707374.555136:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c11180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874546729765120:192.168.204.46@tcp:104: 00000100:00100000:0.0:1787707374.555244:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2a583a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787707374.559464:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c11180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874546729765120:192.168.204.46@tcp:104: 00010000:00010000:0.0:1787707374.559497:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1761 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707374.560729:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707374.560814:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707752448 00000100:00100000:0.0:1787707374.560833:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707752448 00010000:00010000:0.0:1787707374.560874:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec1745 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fc2 expref: 56 pid: 8469 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707374.560925:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 77 00000100:00100000:0.0:1787707374.560936:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a555f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+56:2362:x1874546707752448:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707374.560952:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707374.560960:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec1745 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fc2 expref: 56 pid: 8469 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.560975:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec1745 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fc2 expref: 56 pid: 8469 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.560998:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec1745 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fc2 expref: 56 pid: 8469 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.561015:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:0.0:1787707374.561021:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1761 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.561030:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1761 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.561038:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1761 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.561070:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707374.561281:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a555f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+55:2362:x1874546707752448:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 345us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707374.561298:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 77 00010000:00010000:2.0:1787707374.561510:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1761 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.561519:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1761 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707374.561540:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787707374.561688:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec175a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fc9 expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.561704:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1761 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fc9 expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.561713:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:2.0:1787707374.561716:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787707374.561719:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2800, rc 0) 00000100:00100000:2.0:1787707374.561760:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+55:11643:x1874546707752320:12345-192.168.204.46@tcp:101:bash.0 Request processed in 6964us (7194us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787707374.561768:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 207 00000100:00100000:2.0:1787707374.566252:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707374.566340:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707752704 00000100:00100000:0.0:1787707374.566351:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707752704 00000100:00100000:0.0:1787707374.566453:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 208 00000100:00100000:0.0:1787707374.566465:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+55:11643:x1874546707752704:12345-192.168.204.46@tcp:36:bash.0 00010000:00010000:0.0:1787707374.566763:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec176f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.566781:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec176f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.566802:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec176f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787707374.566857:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1787707374.566888:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008cefd90a reply state 000000003a527c0d transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec176f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707374.566899:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787707374.567008:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+58:11643:x1874546707752704:12345-192.168.204.46@tcp:36:bash.0 Request processed in 544us (766us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1787707374.567015:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 208 00000020:00080000:0.0:1787707374.567020:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787707374.572604:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707374.573568:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707752832 00000100:00100000:1.0:1787707374.573596:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707752832 00000100:00100000:1.0:1787707374.573666:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 209 00000100:00100000:1.0:1787707374.573678:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+58:11643:x1874546707752832:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:1.0:1787707374.573710:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707374.573734:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1776 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9fd0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.573741:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec176f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.573757:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec176f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.573763:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec176f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.573769:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707374.573773:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec176f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.573829:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec177d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.573843:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1761 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fc9 expref: 59 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.573938:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec176f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.573946:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec177d lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.573955:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec176f lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.573964:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec176f lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.573969:0:5857:0:(ldlm_request.c:1774:ldlm_cli_cancel()) ### lock is already being destroyed 00010000:00010000:2.0:1787707374.573971:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:2.0:1787707374.573974:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707374.573977:0:3300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec177d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.573985:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec176f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.573990:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec176f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.574005:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1761 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fc9 expref: 58 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.574021:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1761 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fc9 expref: 58 pid: 5858 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707374.574041:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa0871ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874546729765248:192.168.204.46@tcp:104: 00000100:00100000:1.0:1787707374.574148:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05edb840 going to sleep for 11 seconds 00000100:00100000:1.0:1787707374.577506:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa0871ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874546729765248:192.168.204.46@tcp:104: 00010000:00010000:1.0:1787707374.577540:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec177d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707374.579093:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707374.583405:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707752960 00000100:00100000:2.0:1787707374.583421:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707752960 00010000:00010000:2.0:1787707374.583484:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1761 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fc9 expref: 59 pid: 5858 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707374.583584:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 78 00000100:00100000:2.0:1787707374.583596:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+59:2362:x1874546707752960:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787707374.583638:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707374.583647:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1761 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fc9 expref: 59 pid: 5858 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.583662:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1761 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fc9 expref: 59 pid: 5858 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.583686:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec1761 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fc9 expref: 59 pid: 5858 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.583703:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:2.0:1787707374.583708:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec177d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.583718:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec177d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.583724:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec177d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.583759:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707374.583847:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+58:2362:x1874546707752960:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 253us (4761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707374.583855:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 78 00010000:00010000:0.0:1787707374.583929:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec177d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.583938:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec177d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707374.583990:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787707374.584003:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787707374.584028:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec177d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.584063:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1776 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fd0 expref: 58 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.584078:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec177d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fd0 expref: 57 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.584099:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:0.0:1787707374.584102:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787707374.584105:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a15400, rc 0) 00000100:00100000:0.0:1787707374.584137:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+57:11643:x1874546707752832:12345-192.168.204.46@tcp:101:bash.0 Request processed in 10462us (11545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707374.584145:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 209 00000100:00100000:3.0:1787707374.587183:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707374.587308:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707753216 00000100:00100000:0.0:1787707374.587320:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707753216 00000100:00100000:0.0:1787707374.587404:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 59 00000100:00100000:0.0:1787707374.587415:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+57:11643:x1874546707753216:12345-192.168.204.46@tcp:35:bash.0 00000100:00100000:0.0:1787707374.587698:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+58:11643:x1874546707753216:12345-192.168.204.46@tcp:35:bash.0 Request processed in 283us (525us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1787707374.587705:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 59 00000100:00100000:3.0:1787707374.641010:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707374.641147:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707753344 00000100:00100000:2.0:1787707374.641159:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707753344 00000100:00100000:2.0:1787707374.641225:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 210 00000100:00100000:2.0:1787707374.641236:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+58:11649:x1874546707753344:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:2.0:1787707374.641293:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707374.641317:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1784 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9fd7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.641426:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec178b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.641450:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec178b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.641462:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec178b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707374.641524:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787707374.641528:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787707374.641550:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec178b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.641577:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1784 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fd7 expref: 60 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.641598:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec178b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fd7 expref: 59 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707374.641606:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:2.0:1787707374.641609:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787707374.641612:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871b600, rc 0) 00000100:00100000:2.0:1787707374.641678:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+59:11649:x1874546707753344:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 443us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707374.641685:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 210 00000100:00100000:2.0:1787707374.650203:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707374.651541:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707753472 00000100:00100000:3.0:1787707374.651555:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707753472 00000100:00100000:3.0:1787707374.651677:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 211 00000100:00100000:3.0:1787707374.651691:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+59:11649:x1874546707753472:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:3.0:1787707374.651712:0:12425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707374.651738:0:12425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1792 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9fde expref: -99 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.651809:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1799 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.651824:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1799 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.651835:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1799 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.651850:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec17a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.651856:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec17a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.651862:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec17a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.651981:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec17a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.651990:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec17a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.651996:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec17a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707374.652032:0:12425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787707374.652037:0:12425:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787707374.652056:0:12425:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec17a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.652069:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec17a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.652077:0:12425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1799 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.652095:0:12425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1799 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.652101:0:12425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1799 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.652107:0:12425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa00030800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707374.652112:0:12425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1799 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.652128:0:12425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1799 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.652148:0:12425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:3.0:1787707374.652151:0:12425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707374.652156:0:12425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1799 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.652163:0:12425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1799 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.652177:0:12425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec17a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.652183:0:12425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec17a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.652189:0:12425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec17a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.652194:0:12425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa00030600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707374.652198:0:12425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec17a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.652204:0:12425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec17a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.652212:0:12425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cfa143e4d00) 00010000:00010000:3.0:1787707374.652214:0:12425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707374.652217:0:12425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec17a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.652223:0:12425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec17a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.652342:0:12425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1792 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fde expref: 61 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.652359:0:12425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec17a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fde expref: 60 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.652367:0:12425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:3.0:1787707374.652402:0:12425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787707374.652405:0:12425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa00031200, rc 0) 00000100:00100000:3.0:1787707374.652488:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+60:11649:x1874546707753472:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 800us (2295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707374.652496:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 211 00000100:00100000:0.0:1787707374.655808:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707374.655877:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707753600 00000100:00100000:3.0:1787707374.655890:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707753600 00000100:00100000:3.0:1787707374.655990:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 16 00000100:00100000:3.0:1787707374.656001:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+60:2360:x1874546707753600:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787707374.656017:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707374.656042:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec17a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fde expref: 60 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.656062:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:3.0:1787707374.656067:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707374.656154:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+59:2360:x1874546707753600:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 154us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707374.656162:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 16 00000100:00100000:2.0:1787707374.658767:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707374.658975:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707753856 00000100:00100000:0.0:1787707374.658985:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707753856 00000100:00100000:0.0:1787707374.659040:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 212 00000100:00100000:0.0:1787707374.659050:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+59:11649:x1874546707753856:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:0.0:1787707374.659079:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707374.659113:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec17ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9fe5 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.659216:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec17b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.659229:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec177d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fd0 expref: 60 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.659237:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec17b5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.659277:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec177d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fd0 expref: 60 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.659290:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec177d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fd0 expref: 60 pid: 5857 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707374.659304:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874546729765376:192.168.204.46@tcp:104: 00000100:00100000:0.0:1787707374.659551:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0734f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707374.665449:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874546729765376:192.168.204.46@tcp:104: 00010000:00010000:0.0:1787707374.665482:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec17b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707374.666204:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707374.666277:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707753984 00000100:00100000:1.0:1787707374.666285:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707753984 00010000:00010000:1.0:1787707374.666323:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec177d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fd0 expref: 61 pid: 5857 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707374.666361:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 79 00000100:00100000:1.0:1787707374.666392:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a554700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+61:2361:x1874546707753984:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787707374.666408:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707374.666415:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec177d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fd0 expref: 61 pid: 5857 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.666428:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec177d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fd0 expref: 61 pid: 5857 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.666460:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec177d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fd0 expref: 61 pid: 5857 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.666475:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:1.0:1787707374.666480:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec17b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.666490:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec17b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.666515:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec17b5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707374.666541:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707374.666595:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a554700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+60:2361:x1874546707753984:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 225us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707374.666602:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 79 00010000:00010000:0.0:1787707374.666768:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec17b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.666783:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec17b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707374.666807:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787707374.666949:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec17ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fe5 expref: 61 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.666964:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec17b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fe5 expref: 60 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.666972:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:0.0:1787707374.666974:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787707374.666977:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3200, rc 0) 00000100:00100000:0.0:1787707374.667001:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+60:11649:x1874546707753856:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 7953us (8256us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1787707374.667008:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 212 00000100:00100000:1.0:1787707374.670453:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707374.670565:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707754240 00000100:00100000:0.0:1787707374.670576:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707754240 00000100:00100000:0.0:1787707374.670638:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 17 00000100:00100000:0.0:1787707374.670649:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa113cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+60:11649:x1874546707754240:12345-192.168.204.46@tcp:103:lfs.0 00010000:00010000:0.0:1787707374.670670:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707374.670700:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec1714 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fbb expref: 60 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.670719:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:0.0:1787707374.670725:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707374.670776:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa113cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+59:11649:x1874546707754240:12345-192.168.204.46@tcp:103:lfs.0 Request processed in 129us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707374.670795:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 17 00000100:00100000:3.0:1787707374.673869:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707374.673960:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707754368 00000100:00100000:0.0:1787707374.673972:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707754368 00000100:00100000:0.0:1787707374.674037:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 213 00000100:00100000:0.0:1787707374.674049:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+59:11649:x1874546707754368:12345-192.168.204.46@tcp:58:lfs.0 00010000:00010000:0.0:1787707374.674159:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec17c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.674175:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec17c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707374.674186:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec17c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787707374.674435:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1787707374.674533:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+59:11649:x1874546707754368:12345-192.168.204.46@tcp:58:lfs.0 Request processed in 485us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707374.674541:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 213 00000100:00100000:2.0:1787707374.677556:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707374.677763:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707754496 00000100:00100000:3.0:1787707374.677773:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707754496 00000100:00100000:3.0:1787707374.677884:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 214 00000100:00100000:3.0:1787707374.677907:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+59:11649:x1874546707754496:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:3.0:1787707374.677930:0:12425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707374.677954:0:12425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec17ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9fec expref: -99 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.678015:0:12425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec17c3 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.678027:0:12425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec17ca lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fec expref: 60 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.678048:0:12425:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec17c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.678063:0:12425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec17ca lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fec expref: 60 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.678077:0:12425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:3.0:1787707374.678080:0:12425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787707374.678084:0:12425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec17ca lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fec expref: 60 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707374.678093:0:12425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa00031200, rc 0) 00000100:00100000:3.0:1787707374.678202:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+60:11649:x1874546707754496:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 307us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707374.678227:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 214 00010000:00010000:1.0:1787707374.842644:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707374.907296:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729765760:0@lo:400:kworker.0 00000100:00100000:0.0:1787707374.907301:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729765888:0@lo:400:kworker.0 00000100:00100000:1.0:1787707374.907458:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729765632:0@lo:400:kworker.0 00000100:00100000:2.0:1787707374.907772:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729765504:0@lo:400:kworker.0 00000100:00100000:0.0:1787707374.911663:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707374.911765:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729765888 00000100:00100000:0.0:1787707374.911774:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729765888 00000100:00100000:0.0:1787707374.911833:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787707374.911843:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1874546729765888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707374.911897:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1874546729765888:12345-0@lo:400:kworker.0 Request processed in 56us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707374.911903:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1787707374.911921:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787707374.911948:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729765888:0@lo:400:kworker.0 00000100:00100000:3.0:1787707374.914733:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707374.915678:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729765760 00000100:00100000:0.0:1787707374.915690:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729765760 00000100:00100000:0.0:1787707374.915747:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787707374.915756:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729765760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707374.915826:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729765760:12345-0@lo:400:kworker.0 Request processed in 72us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707374.915833:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:0.0:1787707374.915864:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707374.917783:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729765760:0@lo:400:kworker.0 00000100:00100000:1.0:1787707374.925537:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707374.925760:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729765632 00000100:00100000:3.0:1787707374.925838:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729765632 00000100:00100000:3.0:1787707374.925895:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787707374.925905:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa0871ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729765632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707374.925964:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa0871ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729765632:12345-0@lo:400:kworker.0 Request processed in 61us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707374.925971:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787707374.926205:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729765632:0@lo:400:kworker.0 00000100:00100000:2.0:1787707374.928395:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707374.928469:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874546729766016:0@lo:400:kworker.0 00000100:00100000:2.0:1787707374.928505:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707374.928550:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729766016 00000100:00100000:2.0:1787707374.928557:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729766016 00000100:00100000:2.0:1787707374.928615:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787707374.928623:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874546729766016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707374.928675:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874546729766016:12345-0@lo:400:kworker.0 Request processed in 52us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707374.928682:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787707374.928725:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874546729766016:0@lo:400:kworker.0 00000100:00100000:1.0:1787707374.928847:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729765504 00000100:00100000:1.0:1787707374.928852:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729765504 00000100:00100000:1.0:1787707374.928887:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787707374.928895:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07315850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3316:x1874546729765504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707374.928933:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07315850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3316:x1874546729765504:12345-0@lo:400:kworker.0 Request processed in 39us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707374.928939:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787707374.929009:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729765504:0@lo:400:kworker.0 00000100:00080000:0.0:1787707374.929094:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1787707374.978919:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1787707374.978938:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000040:00080000:3.0:1787707375.033639:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787707375.033648:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787707375.033687:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787707375.033692:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787707375.033829:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f4cb480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874546729766144:192.168.204.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787707375.033952:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa12a7a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787707375.038522:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707375.039582:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707754624 00000100:00100000:0.0:1787707375.039593:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707754624 00000100:00100000:0.0:1787707375.039671:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 215 00000100:00100000:0.0:1787707375.039682:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+61:11650:x1874546707754624:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787707375.039726:0:5856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787707375.039855:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+61:11650:x1874546707754624:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 Request processed in 174us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707375.039863:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 215 00000100:00100000:3.0:1787707375.039971:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f4cb480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874546729766144:192.168.204.46@tcp:107:hsm_cdtr.0 00000100:00080000:1.0:1787707375.040200:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787707375.046279:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707375.046419:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707754752 00000100:00100000:3.0:1787707375.046442:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707754752 00000100:00100000:3.0:1787707375.046570:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 216 00000100:00100000:3.0:1787707375.046581:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+60:11650:x1874546707754752:12345-192.168.204.46@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787707375.046665:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec17d1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.046706:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec17d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.046721:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec17d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.046737:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec17d8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.046744:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec17d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.046751:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec17d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.046788:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec17df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.046797:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec17df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.046803:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec17df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707375.046843:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787707375.046848:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787707375.046860:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec17df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.046871:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec17d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.046887:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec17d1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.046894:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec17d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.046909:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa00031c00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707375.046913:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec17d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.046921:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec17d1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.046934:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfa06897a00) 00010000:00010000:3.0:1787707375.046937:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707375.046941:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec17d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.046948:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec17d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.046963:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec17d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.046968:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec17d8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.046975:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec17d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.046980:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa00030600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707375.046989:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec17d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.046996:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec17d8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.047003:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8cfa143e4d00) 00010000:00010000:3.0:1787707375.047005:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707375.047007:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec17d8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.047013:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec17d8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.047027:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec17df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.047033:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec17df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.047039:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec17df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.047043:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa00030800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707375.047046:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec17df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.047052:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec17df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.047058:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:3.0:1787707375.047324:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707375.047334:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec17df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.047341:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec17df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707375.047529:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+60:11650:x1874546707754752:12345-192.168.204.46@tcp:34:lhsmtool_posix.0 Request processed in 947us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707375.047537:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 216 00000100:00100000:0.0:1787707375.050724:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707375.050868:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707755008 00000100:00100000:2.0:1787707375.050879:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707755008 00000100:00100000:2.0:1787707375.050971:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 217 00000100:00100000:2.0:1787707375.050983:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+60:11650:x1874546707755008:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787707375.051004:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707375.051044:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec17e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9ff3 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.051165:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec17ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.051185:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec17ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.051199:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec17ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707375.051212:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787707375.051325:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec17ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.051333:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec17ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.051339:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec17ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.051344:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871a600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707375.051348:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec17ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.051356:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec17ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.051399:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:2.0:1787707375.051402:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787707375.051407:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec17ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.051423:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec17ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.051482:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec17e6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ff3 expref: 62 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.051492:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfa06897a00) 00010000:00010000:2.0:1787707375.051494:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787707375.051499:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec17e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ff3 expref: 62 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.051508:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871bc00, rc 0) 00000100:00100000:2.0:1787707375.051688:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+61:11650:x1874546707755008:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 706us (972us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1787707375.051696:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 217 00000100:00100000:1.0:1787707375.058126:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707375.058225:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707755136 00000100:00100000:2.0:1787707375.058237:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707755136 00000100:00100000:2.0:1787707375.058301:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 218 00000100:00100000:2.0:1787707375.058312:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+61:11650:x1874546707755136:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787707375.058361:0:8469:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787707375.058518:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+61:11650:x1874546707755136:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 Request processed in 208us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707375.058526:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 218 00000100:00100000:1.0:1787707375.069705:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707375.069815:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707755392 00000100:00100000:3.0:1787707375.069826:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707755392 00000100:00100000:3.0:1787707375.069903:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 219 00000100:00100000:3.0:1787707375.069916:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa06ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+61:11650:x1874546707755392:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787707375.069940:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707375.069944:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787707375.069974:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b600/0xc5f18d5f94ec178b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fd7 expref: 61 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.069995:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:3.0:1787707375.070000:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787707375.070015:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec17fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0b9ffa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787707375.070525:0:5858:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1787707375.070859:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec1802 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.070877:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec1802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.070910:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec1802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.070975:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec17fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ffa expref: 63 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.070994:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec1802 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ffa expref: 62 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.071003:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cfa143e4d00) 00010000:00010000:3.0:1787707375.071006:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787707375.071009:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa00030600, rc 0) 00000100:00100000:3.0:1787707375.071078:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa06ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+62:11650:x1874546707755392:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 1166us (1387us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1787707375.071087:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 219 00000100:00100000:0.0:1787707375.085123:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707375.088336:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707755648 00000100:00100000:2.0:1787707375.088358:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707755648 00000100:00100000:2.0:1787707375.088576:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 220 00000100:00100000:2.0:1787707375.088610:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+62:11650:x1874546707755648:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787707375.088687:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707375.088720:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec1802 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ffa expref: 62 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.088745:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cfa143e4d00) 00010000:00010000:2.0:1787707375.088758:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787707375.088782:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1810 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.088797:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1810 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.088809:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1810 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.088824:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1817 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xbff89844 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.088831:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbff89844 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.088839:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbff89844 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.088924:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1810 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.088932:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1810 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.088950:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1810 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.088957:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871bc00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707375.088962:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1810 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.088970:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1810 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.088980:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:2.0:1787707375.088983:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707375.088987:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1810 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.088994:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1810 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.089004:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbff89844 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.089011:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1817 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbff89844 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.089017:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1817 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbff89844 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.089022:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871a600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707375.089025:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1817 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbff89844 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.089042:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1817 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbff89844 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.089050:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xbff89844 (ffff8cfa12a49200) 00010000:00010000:2.0:1787707375.089052:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707375.089054:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1817 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbff89844 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.089059:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1817 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbff89844 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707375.089159:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+61:11650:x1874546707755648:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 Request processed in 552us (4047us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787707375.089167:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 220 00000100:00100000:2.0:1787707375.105272:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707375.108739:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707755776 00000100:00100000:3.0:1787707375.108758:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707755776 00000100:00100000:3.0:1787707375.108934:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 221 00000100:00100000:3.0:1787707375.108951:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+61:11650:x1874546707755776:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787707375.108983:0:12425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707375.109016:0:12425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec181e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba001 expref: -99 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.109059:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1825 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.109075:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.109107:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.109211:0:12425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec181e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba001 expref: 63 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.109233:0:12425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba001 expref: 62 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.109242:0:12425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cfa143e4900) 00010000:00010000:3.0:1787707375.109245:0:12425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787707375.109249:0:12425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa00031c00, rc 0) 00000100:00100000:3.0:1787707375.109317:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+62:11650:x1874546707755776:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 371us (4058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707375.109324:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 221 00000100:00100000:1.0:1787707375.120024:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707375.120120:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707756032 00000100:00100000:0.0:1787707375.120132:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707756032 00000100:00100000:0.0:1787707375.120199:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 222 00000100:00100000:0.0:1787707375.120211:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a5ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+62:11650:x1874546707756032:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787707375.120304:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec182c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.120690:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec182c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.120720:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec182c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787707375.121138:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1787707375.121150:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 426167778629ns, next at 427167775783ns, rc = 0 00000004:00010000:0.0:1787707375.121244:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac837aae reply state 0000000054394e26 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec182c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707375.121254:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787707375.122502:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a5ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+64:11650:x1874546707756032:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 Request processed in 2286us (2482us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1787707375.122512:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 222 00010000:00010000:2.0:1787707375.129127:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec182c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.129147:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec182c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.129156:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec182c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.129163:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707375.129168:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec182c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.129176:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec182c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.129216:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cfa143e4900) 00010000:00010000:2.0:1787707375.129220:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787707375.129225:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec182c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.129231:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec182c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707375.164927:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707375.166749:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707756160 00000100:00100000:2.0:1787707375.166762:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707756160 00000100:00100000:2.0:1787707375.167238:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 223 00000100:00100000:2.0:1787707375.167250:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+63:11650:x1874546707756160:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787707375.167276:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707375.167300:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1833 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba008 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.167399:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1833 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba008 expref: 64 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.167415:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1833 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba008 expref: 64 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.167445:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cfa143e4900) 00010000:00010000:2.0:1787707375.167449:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787707375.167453:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871bc00, rc 0) 00000100:00100000:2.0:1787707375.167527:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+64:11650:x1874546707756160:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 279us (2611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707375.167566:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 223 00000100:00100000:3.0:1787707375.175296:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707375.176897:0:12022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707756288 00000100:00100000:0.0:1787707375.176909:0:12022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707756288 00000100:00100000:0.0:1787707375.177065:0:12022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 62 00000100:00100000:0.0:1787707375.177077:0:12022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+9:2362:x1874546707756288:12345-192.168.204.46@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787707375.178856:0:12022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+10:2362:x1874546707756288:12345-192.168.204.46@tcp:2:lhsmtool_posix.0 Request processed in 1773us (3562us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787707375.178869:0:12022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 62 00000100:00080000:1.0:1787707375.180911:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787707375.184122:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707375.184258:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707756544 00000100:00100000:3.0:1787707375.184268:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707756544 00000100:00100000:3.0:1787707375.184336:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 60 00000100:00100000:3.0:1787707375.184348:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+64:11650:x1874546707756544:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787707375.184628:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+65:11650:x1874546707756544:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 Request processed in 282us (515us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1787707375.184636:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 60 00000100:00100000:3.0:1787707375.190917:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707375.191126:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707756800 00000100:00100000:2.0:1787707375.191136:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707756800 00000100:00100000:2.0:1787707375.191191:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 224 00000100:00100000:2.0:1787707375.191202:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+65:11650:x1874546707756800:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787707375.191332:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+65:11650:x1874546707756800:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 Request processed in 131us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707375.191341:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 224 00000100:00100000:1.0:1787707375.197668:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707375.200251:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707756928 00000100:00100000:0.0:1787707375.200272:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707756928 00000100:00100000:0.0:1787707375.200729:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 225 00000100:00100000:0.0:1787707375.200744:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3abff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+65:11650:x1874546707756928:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787707375.200766:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707375.200791:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec183a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba00f expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.200904:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1841 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.200919:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.200931:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707375.200968:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787707375.200986:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.201013:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2000/0xc5f18d5f94ec183a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba00f expref: 67 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.201044:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1841 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba00f expref: 66 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.201054:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cfa143e4900) 00010000:00010000:0.0:1787707375.201056:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787707375.201060:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3000, rc 0) 00000100:00100000:0.0:1787707375.201139:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3abff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+66:11650:x1874546707756928:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 400us (3483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707375.201146:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 225 00000100:00100000:1.0:1787707375.210288:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707375.213230:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707757056 00000100:00100000:3.0:1787707375.213246:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707757056 00000100:00100000:3.0:1787707375.213336:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 63 00000100:00100000:3.0:1787707375.213348:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+10:2361:x1874546707757056:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787707375.213387:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707375.213412:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001593c2c2/0xc5f18d5f94ec1848 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba016 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787707375.213451:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8e3fed, blocks: 0x1 00010000:00010000:3.0:1787707375.213473:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1787707375.213477:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707375.213487:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001593c2c2/0xc5f18d5f94ec1848 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba016 expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.213507:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001593c2c2/0xc5f18d5f94ec1848 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba016 expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.213522:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa00030800, rc 0) 00000100:00100000:3.0:1787707375.215207:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+11:2361:x1874546707757056:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 1850us (4919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707375.215220:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 63 00000100:00100000:1.0:1787707375.224771:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707375.224926:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707757312 00000100:00100000:2.0:1787707375.224937:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707757312 00000100:00100000:2.0:1787707375.225003:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 226 00000100:00100000:2.0:1787707375.225015:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+66:11650:x1874546707757312:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787707375.225139:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+66:11650:x1874546707757312:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 Request processed in 125us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707375.225146:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 226 00000100:00100000:1.0:1787707375.236254:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707375.236475:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707757440 00000100:00100000:0.0:1787707375.236485:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707757440 00000100:00100000:0.0:1787707375.236620:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 64 00000100:00100000:0.0:1787707375.236647:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+11:11650:x1874546707757440:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787707375.236665:0:8265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707375.236683:0:8265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec184f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba01d expref: -99 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.236719:0:8265:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001593c2c2/0xc5f18d5f94ec1848 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba016 expref: 12 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.236728:0:8265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707375.236733:0:8265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707375.236738:0:8265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec184f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba01d expref: 12 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.236787:0:8265:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001593c2c2/0xc5f18d5f94ec1848 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba016 expref: 12 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.236804:0:8265:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001593c2c2/0xc5f18d5f94ec1848 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba016 expref: 12 pid: 6690 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707375.236819:0:8265:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8265:1874546729766272:192.168.204.46@tcp:104: 00000100:00100000:0.0:1787707375.236965:0:8265:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05e2d480 going to sleep for 11 seconds 00000100:00100000:1.0:1787707375.254295:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707375.256178:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707757568 00000100:00100000:2.0:1787707375.256194:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707757568 00010000:00010000:2.0:1787707375.256258:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001593c2c2/0xc5f18d5f94ec1848 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba016 expref: 13 pid: 6690 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707375.256322:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 80 00000100:00100000:2.0:1787707375.256331:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+13:2362:x1874546707757568:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787707375.256348:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707375.256407:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001593c2c2/0xc5f18d5f94ec1848 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba016 expref: 13 pid: 6690 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.256452:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001593c2c2/0xc5f18d5f94ec1848 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba016 expref: 13 pid: 6690 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.256478:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707375.256483:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707375.256491:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec184f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba01d expref: 13 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.256500:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec184f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba01d expref: 13 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.256540:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec184f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba01d expref: 13 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707375.256566:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41ca3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5842:1874546729766400:192.168.204.46@tcp:105: 00000100:00100000:2.0:1787707375.256647:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073bc6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787707375.258993:0:8265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001593c2c2/0xc5f18d5f94ec1848 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba016 expref: 13 pid: 6690 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707375.259022:0:8265:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8265:1874546729766272:192.168.204.46@tcp:104: 00010000:00010000:0.0:1787707375.259477:0:8265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec184f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba01d expref: 12 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.259495:0:8265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2000, rc 0) 00000100:00100000:1.0:1787707375.260234:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41ca3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5842:1874546729766400:192.168.204.46@tcp:105: 00010000:00010000:1.0:1787707375.260252:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707375.260299:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+12:2362:x1874546707757568:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 3967us (6017us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707375.260309:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 80 00000100:00100000:0.0:1787707375.260940:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+11:11650:x1874546707757440:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 24292us (24692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707375.260949:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 64 00000100:00100000:2.0:1787707375.264348:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707375.264643:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707757696 00000100:00100000:1.0:1787707375.264653:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707757696 00002000:00100000:1.0:1787707375.264705:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8cfa41ca2680 x1874546707757696/t0(0) o4->9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp:266/0 lens 504/0 e 0 to 0 dl 1787707386 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787707375.264717:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa41ca2680 with x1874546707757696 ext(0->12) 00002000:00010000:1.0:1787707375.264722:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfa41ca2680 00000100:00100000:1.0:1787707375.264752:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 6 00000100:00100000:1.0:1787707375.264762:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+11:2360:x1874546707757696:12345-192.168.204.46@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787707375.265892:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+13:2360:x1874546707757696:12345-192.168.204.46@tcp:4:lhsmtool_posix.0 Request processed in 1125us (1549us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1787707375.265904:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 6 00002000:00100000:1.0:1787707375.265914:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8cfa41ca2680 x1874546707757696/t4294967320(0) o4->9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp:266/0 lens 504/448 e 0 to 0 dl 1787707386 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787707375.265924:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa41ca2680 with x1874546707757696 ext(0->12) 00002000:00010000:1.0:1787707375.265938:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfa41ca2680 00000100:00100000:1.0:1787707375.274131:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707375.274285:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707757824 00000100:00100000:3.0:1787707375.274297:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707757824 00000100:00100000:3.0:1787707375.274407:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 227 00000100:00100000:3.0:1787707375.274418:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+66:11650:x1874546707757824:12345-192.168.204.46@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787707375.318904:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1787707375.318917:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1787707375.318942:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1787707375.318958:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cfa2a583f00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1787707375.318964:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfa20279300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cfa2a583240 00000020:00080000:1.0:1787707375.318967:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfa20279800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cfa3ac4c400 00000020:00080000:1.0:1787707375.319009:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cfa065b3480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1787707375.319012:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfa05807000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cfa065b3a80 00000020:00080000:1.0:1787707375.319014:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfa05807400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cfa2f4ee800 00000001:00080000:1.0:1787707375.319025:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1787707375.319044:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1787707375.319215:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:2.0:1787707375.319401:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787707375.319540:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa059b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729766528:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787707375.319610:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707375.319665:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729766528 00000100:00100000:2.0:1787707375.319672:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729766528 00000100:00100000:2.0:1787707375.319713:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787707375.319734:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1874546729766528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787707375.319757:0:6688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1787707375.319905:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfbdaf3f/0xc5f18d5f94ec1856 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.319927:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1618 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f7c expref: 12 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.319935:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787707375.319940:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787707375.319946:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfbdaf3f/0xc5f18d5f94ec1856 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.319986:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1618 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f7c expref: 12 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.320002:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1618 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f7c expref: 12 pid: 8265 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707375.320015:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f155180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1874546729766912:192.168.204.46@tcp:104: 00000100:00100000:2.0:1787707375.320078:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073bc840 going to sleep for 11 seconds 00000100:00100000:3.0:1787707375.321363:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+20:11650:x1874546707757824:12345-192.168.204.46@tcp:44:lhsmtool_posix.0 Request processed in 46939us (47234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707375.321391:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 227 00000020:00080000:1.0:1787707375.322546:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787707375.322578:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa059b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729766656:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787707375.322637:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707375.322681:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787707375.322687:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa059b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729766784:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787707375.322707:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707375.322805:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729766656 00000100:00100000:3.0:1787707375.322812:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729766656 00000100:00100000:3.0:1787707375.322851:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729766784 00000100:00100000:3.0:1787707375.322854:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729766784 00000100:00100000:3.0:1787707375.322878:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787707375.322887:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1874546729766656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787707375.322896:0:12022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787707375.322909:0:12022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729766784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787707375.322928:0:12022:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1787707375.322959:0:12022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8e3fec, atime: 0x6a8e3fed, ctime: 0x6a8e3fec, blocks: 0xb 00010000:00010000:0.0:1787707375.322967:0:12022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005367dc49/0xc5f18d5f94ec185d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.322981:0:12022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787707375.322985:0:12022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707375.322991:0:12022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005367dc49/0xc5f18d5f94ec185d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.323006:0:12022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005367dc49/0xc5f18d5f94ec185d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.323016:0:12022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005367dc49/0xc5f18d5f94ec185d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.323023:0:12022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005367dc49/0xc5f18d5f94ec185d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.323050:0:12022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787707375.323052:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787707375.323056:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787707374 00002000:00010000:3.0:1787707375.323059:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787707375.323061:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787707373 -> 1787707374 00002000:00010000:3.0:1787707375.323076:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787707375.323119:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3314:x1874546729766656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 234us (482us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787707375.323126:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:1.0:1787707375.323202:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787707375.323288:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005367dc49/0xc5f18d5f94ec185d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707375.323298:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3a00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:1.0:1787707375.323303:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005367dc49/0xc5f18d5f94ec185d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707375.323320:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005367dc49/0xc5f18d5f94ec185d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707375.323338:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005367dc49/0xc5f18d5f94ec185d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707375.323348:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005367dc49/0xc5f18d5f94ec185d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707375.323405:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707375.323407:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707375.323409:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787707375.323451:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfa059b2300/2, rc 0, transno 4294967321 00000100:00100000:1.0:1787707375.323458:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa059b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729766656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787707375.323559:0:12022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3314:x1874546729766784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 653us (848us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787707375.323566:0:12022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787707375.323665:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1787707375.323670:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfa2f689180, transno 4294967307 00000004:00080000:1.0:1787707375.323687:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:1.0:1787707375.323708:0:3314:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8cfa059b3480 x1874546729766784/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787707391 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787707375.323717:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfa059b3480/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787707375.323723:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa059b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729766784:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787707375.324138:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707375.324317:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707757952 00000100:00100000:3.0:1787707375.324322:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707757952 00010000:00010000:3.0:1787707375.324347:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1618 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f7c expref: 13 pid: 8265 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707375.324404:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 81 00000100:00100000:3.0:1787707375.324412:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+13:2361:x1874546707757952:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787707375.324438:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707375.324445:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1618 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f7c expref: 13 pid: 8265 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.324458:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1618 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f7c expref: 13 pid: 8265 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.324492:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787707375.324496:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787707375.324502:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cfbdaf3f/0xc5f18d5f94ec1856 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.324511:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfbdaf3f/0xc5f18d5f94ec1856 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.324528:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707375.324567:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+13:2361:x1874546707757952:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 155us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707375.324573:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 81 00010000:00010000:2.0:1787707375.324742:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1618 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f7c expref: 12 pid: 8265 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707375.324758:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f155180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1874546729766912:192.168.204.46@tcp:104: 00010000:00010000:2.0:1787707375.324783:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cfbdaf3f/0xc5f18d5f94ec1856 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.324804:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cfbdaf3f/0xc5f18d5f94ec1856 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.324811:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfbdaf3f/0xc5f18d5f94ec1856 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.324820:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfbdaf3f/0xc5f18d5f94ec1856 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.324827:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfbdaf3f/0xc5f18d5f94ec1856 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.324851:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787707375.325284:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3316:x1874546729766528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5563us (5673us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787707375.325292:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:2.0:1787707375.325328:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfa059b2680/2, rc 0, transno 4294967322 00000100:00100000:2.0:1787707375.325334:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa059b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729766528:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787707375.325561:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707375.325569:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfbdaf3f/0xc5f18d5f94ec1856 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.325578:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871ae00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707375.325582:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfbdaf3f/0xc5f18d5f94ec1856 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.325590:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfbdaf3f/0xc5f18d5f94ec1856 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.325604:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfbdaf3f/0xc5f18d5f94ec1856 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.325625:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfbdaf3f/0xc5f18d5f94ec1856 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.325644:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707375.325657:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707375.325659:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707375.329498:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707375.329612:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707758080 00000100:00100000:3.0:1787707375.329621:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707758080 00000100:00100000:3.0:1787707375.329683:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 68 00000100:00100000:3.0:1787707375.329693:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+12:2361:x1874546707758080:12345-192.168.204.46@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787707375.368928:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:1.0:1787707375.368947:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:1.0:1787707375.368954:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:1.0:1787707375.368989:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:3.0:1787707375.369488:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2361:x1874546707758080:12345-192.168.204.46@tcp:16:lhsmtool_posix.0 Request processed in 39462us (39667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707375.369502:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 68 00000100:00100000:3.0:1787707375.373616:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707375.373710:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707758336 00000100:00100000:0.0:1787707375.373722:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707758336 00000100:00100000:0.0:1787707375.373798:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 228 00000100:00100000:0.0:1787707375.373809:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+20:11650:x1874546707758336:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787707375.373866:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707375.373907:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1841 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba00f expref: 20 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.373933:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cfa143e4900) 00010000:00010000:0.0:1787707375.373939:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787707375.373974:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1864 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.373988:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.373999:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787707375.376055:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d496eae2 reply state 00000000bcd75a00 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707375.376072:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787707375.376347:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+21:11650:x1874546707758336:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 Request processed in 2535us (2736us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1787707375.376356:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 228 00000100:00100000:1.0:1787707375.386930:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707375.387068:0:12022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707758464 00000100:00100000:0.0:1787707375.387079:0:12022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707758464 00000100:00100000:0.0:1787707375.387144:0:12022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 69 00000100:00100000:0.0:1787707375.387155:0:12022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2362:x1874546707758464:12345-192.168.204.46@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787707375.387443:0:12022:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787707375.387448:0:12022:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787707374 -> 1787707373 00002000:00010000:0.0:1787707375.387450:0:12022:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787707373 00002000:00010000:0.0:1787707375.387452:0:12022:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787707374 -> 1787707373 00002000:00010000:0.0:1787707375.387454:0:12022:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787707375.387519:0:12022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2362:x1874546707758464:12345-192.168.204.46@tcp:2:lhsmtool_posix.0 Request processed in 365us (599us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1787707375.387527:0:12022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 69 00010000:00010000:3.0:1787707375.389907:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.389925:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1864 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.389934:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1864 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.389940:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3a00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707375.389945:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1864 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.389976:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1864 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.389995:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cfa143e4900) 00010000:00010000:3.0:1787707375.389998:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707375.390003:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1864 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.390009:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1864 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707375.391276:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707375.391646:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707758720 00000100:00100000:0.0:1787707375.391668:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707758720 00000100:00100000:0.0:1787707375.391726:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 229 00000100:00100000:0.0:1787707375.392018:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+20:11650:x1874546707758720:12345-192.168.204.46@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787707375.392088:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dba00/0xc5f18d5f94ec186b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.392103:0:12425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1825 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba001 expref: 20 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.392113:0:12425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dba00/0xc5f18d5f94ec186b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.392161:0:12425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba001 expref: 20 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707375.392175:0:12425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1825 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba001 expref: 20 pid: 12425 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707375.392189:0:12425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c94700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12425:1874546729767040:192.168.204.46@tcp:104: 00000100:00100000:0.0:1787707375.392275:0:12425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05e2d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787707375.397263:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707375.397473:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707758848 00000100:00100000:2.0:1787707375.397483:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707758848 00010000:00010000:2.0:1787707375.397524:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1825 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba001 expref: 21 pid: 12425 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707375.397569:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 82 00000100:00100000:2.0:1787707375.397595:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+21:2362:x1874546707758848:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787707375.397612:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707375.397620:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1825 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba001 expref: 21 pid: 12425 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.397634:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1825 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba001 expref: 21 pid: 12425 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.397668:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cfa143e4900) 00010000:00010000:2.0:1787707375.397674:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dba00/0xc5f18d5f94ec186b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.397684:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dba00/0xc5f18d5f94ec186b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.397692:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dba00/0xc5f18d5f94ec186b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.397711:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707375.398018:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+21:2362:x1874546707758848:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 425us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707375.398026:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 82 00010000:00010000:3.0:1787707375.398135:0:12425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1825 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba001 expref: 20 pid: 12425 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707375.398154:0:12425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c94700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12425:1874546729767040:192.168.204.46@tcp:104: 00010000:00010000:3.0:1787707375.398175:0:12425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dba00/0xc5f18d5f94ec186b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.398184:0:12425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dba00/0xc5f18d5f94ec186b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.398190:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dba00/0xc5f18d5f94ec186b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.398219:0:12425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dba00/0xc5f18d5f94ec186b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.398226:0:12425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dba00/0xc5f18d5f94ec186b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.398245:0:12425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dba00/0xc5f18d5f94ec186b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.398251:0:12425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3f8dba00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707375.398255:0:12425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dba00/0xc5f18d5f94ec186b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.398262:0:12425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dba00/0xc5f18d5f94ec186b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.398273:0:12425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cfa143e4900) 00010000:00010000:3.0:1787707375.398276:0:12425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787707375.398279:0:12425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dba00/0xc5f18d5f94ec186b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.398285:0:12425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dba00/0xc5f18d5f94ec186b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707375.398338:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+19:11650:x1874546707758720:12345-192.168.204.46@tcp:55:lhsmtool_posix.0 Request processed in 6602us (7068us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787707375.398346:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 229 00000100:00100000:1.0:1787707375.415083:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707375.415192:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707758976 00000100:00100000:2.0:1787707375.415202:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707758976 00000100:00100000:2.0:1787707375.415262:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 70 00000100:00100000:2.0:1787707375.415273:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2362:x1874546707758976:12345-192.168.204.46@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787707375.415337:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec1872 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.415416:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec184f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba01d expref: 8 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.415434:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707375.415439:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787707375.415443:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec1872 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.415481:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec184f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba01d expref: 8 pid: 8265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.415497:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec184f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba01d expref: 8 pid: 8265 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707375.415512:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f154380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1874546729767168:192.168.204.46@tcp:104: 00000100:00100000:2.0:1787707375.415595:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073bc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707375.416529:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787707375.416546:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729767296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787707375.416588:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707375.416671:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729767296 00000100:00100000:3.0:1787707375.416679:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729767296 00000100:00100000:3.0:1787707375.416723:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787707375.416731:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874546729767296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787707375.416760:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787707375.416821:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874546729767296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707375.416841:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787707375.417028:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729767296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787707375.422508:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f154380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1874546729767168:192.168.204.46@tcp:104: 00010000:00010000:2.0:1787707375.422540:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec1872 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707375.424295:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707375.424803:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707759104 00000100:00100000:3.0:1787707375.424812:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707759104 00010000:00010000:3.0:1787707375.424856:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec184f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba01d expref: 9 pid: 8265 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707375.424909:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 83 00000100:00100000:3.0:1787707375.424918:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+9:2362:x1874546707759104:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787707375.424932:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707375.424955:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec184f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba01d expref: 9 pid: 8265 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.424968:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec184f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba01d expref: 9 pid: 8265 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.424991:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003a3ccb9/0xc5f18d5f94ec184f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba01d expref: 9 pid: 8265 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.425007:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787707375.425011:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787707375.425017:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec1872 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.425027:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec1872 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.425457:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707375.425518:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2362:x1874546707759104:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 600us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707375.425527:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 83 00010000:00010000:2.0:1787707375.426890:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec1872 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.426916:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec1872 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.426961:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec1872 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.426969:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec1872 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.426978:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec1872 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.426985:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b400 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707375.426990:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec1872 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.426998:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec1872 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.427016:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec1872 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.427024:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000964a8a18/0xc5f18d5f94ec1872 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707375.427149:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2362:x1874546707758976:12345-192.168.204.46@tcp:1:lhsmtool_posix.0 Request processed in 11874us (12072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707375.427158:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 70 00000100:00100000:1.0:1787707375.430922:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707375.431187:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707759360 00000100:00100000:3.0:1787707375.431198:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707759360 00000100:00100000:3.0:1787707375.431259:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 230 00000100:00100000:3.0:1787707375.431270:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+19:11650:x1874546707759360:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787707375.431362:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1879 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.431696:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.431709:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.432063:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1880 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.432077:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1833 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba008 expref: 20 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.432086:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1880 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.432125:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1833 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba008 expref: 20 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.432158:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1833 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba008 expref: 20 pid: 5857 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707375.432174:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874546729767424:192.168.204.46@tcp:104: 00000100:00100000:3.0:1787707375.432318:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41900540 going to sleep for 11 seconds 00000100:00100000:0.0:1787707375.440053:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707375.440163:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707759488 00000100:00100000:2.0:1787707375.440174:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707759488 00010000:00010000:2.0:1787707375.440223:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1833 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba008 expref: 21 pid: 5857 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707375.440327:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 84 00000100:00100000:2.0:1787707375.440339:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+21:2361:x1874546707759488:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787707375.440357:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707375.440365:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1833 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba008 expref: 21 pid: 5857 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.440398:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1833 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba008 expref: 21 pid: 5857 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.440434:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cfa143e4900) 00010000:00010000:2.0:1787707375.440440:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1880 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.440450:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1880 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.440457:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1880 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.440477:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707375.440540:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+21:2361:x1874546707759488:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 203us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707375.440548:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 84 00010000:00010000:3.0:1787707375.441293:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871bc00/0xc5f18d5f94ec1833 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba008 expref: 20 pid: 5857 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707375.441327:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874546729767424:192.168.204.46@tcp:104: 00010000:00010000:3.0:1787707375.441349:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1880 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.441358:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1880 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.441364:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1880 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787707375.441576:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1787707375.441753:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1787707375.441808:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1787707375.441887:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1874546729767552:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787707375.441944:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707375.441968:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41900d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787707375.442367:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729767552 00000100:00100000:0.0:1787707375.442392:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729767552 00000100:00100000:0.0:1787707375.442448:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787707375.442458:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2a591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8469:x1874546729767552:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787707375.442530:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2a591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8469:x1874546729767552:12345-0@lo:1000:mdt00_003.0 Request processed in 74us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707375.442537:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787707375.443163:0:8469:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1787707375.443171:0:8469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:3.0:1787707375.443191:0:8469:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfa059b2300, transno 4294967321 00000004:00080000:3.0:1787707375.443219:0:8469:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfa059b2680, transno 4294967322 00000100:00100000:3.0:1787707375.443227:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1874546729767552:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787707375.443974:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1787707375.444046:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41fd0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1874546729767680:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787707375.444099:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707375.444124:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa30b2f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707375.444281:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729767680 00000100:00100000:0.0:1787707375.444288:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729767680 00000100:00100000:0.0:1787707375.444521:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787707375.444530:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8469:x1874546729767680:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787707375.444943:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8469:x1874546729767680:12345-0@lo:1000:mdt00_003.0 Request processed in 413us (842us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787707375.444950:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787707375.445875:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41fd0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1874546729767680:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787707375.445998:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1880 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.446019:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1880 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.446027:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1880 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.446033:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa00030800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707375.446038:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1880 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.446045:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1880 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.446061:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cfa143e4900) 00010000:00010000:2.0:1787707375.446064:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787707375.446069:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1880 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.446075:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec1880 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.446106:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec17c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.446112:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec17c3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.446118:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec17c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.446123:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707375.446132:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec17c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.446138:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec17c3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.446147:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:2.0:1787707375.446149:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787707375.446156:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec17ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fec expref: 23 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.446167:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec17ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fec expref: 23 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.446176:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec17ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fec expref: 23 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.446209:0:8469:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec17ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fec expref: 23 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707375.446221:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f154380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874546729767808:192.168.204.46@tcp:105: 00000100:00100000:2.0:1787707375.446536:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073bc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707375.449934:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707375.450006:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f154380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874546729767808:192.168.204.46@tcp:105: 00010000:00010000:2.0:1787707375.450033:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec17c3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.450044:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2800/0xc5f18d5f94ec17c3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.450092:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1887 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.450105:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1887 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.450116:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1887 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.450126:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1887 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.450132:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1887 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.450139:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1887 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.450145:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707375.450148:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1887 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.450155:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1887 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.450165:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:2.0:1787707375.450168:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707375.450171:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1887 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.450176:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1887 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.450190:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.450196:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1879 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.450202:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1879 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.450207:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa00031c00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707375.450210:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1879 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.450216:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1879 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.450222:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:2.0:1787707375.450224:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787707375.450226:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1879 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.450231:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec1879 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707375.450658:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+23:11650:x1874546707759360:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 Request processed in 19375us (19744us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787707375.450669:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 230 00000020:00080000:2.0:1787707375.450674:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787707375.451233:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787707375.451242:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787707375.451963:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787707375.451977:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787707375.452278:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707759616 00000100:00100000:3.0:1787707375.452287:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707759616 00000100:00100000:3.0:1787707375.452461:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 61 00000100:00100000:3.0:1787707375.452472:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+23:11649:x1874546707759616:12345-192.168.204.46@tcp:49:lfs.0 00000100:00100000:3.0:1787707375.452893:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+23:11649:x1874546707759616:12345-192.168.204.46@tcp:49:lfs.0 Request processed in 421us (2966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707375.452901:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 61 00000100:00100000:0.0:1787707375.457698:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707375.457749:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707375.457943:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707760128 00000100:00100000:3.0:1787707375.457955:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707760128 00000100:00100000:3.0:1787707375.458013:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 62 00000100:00100000:3.0:1787707375.458022:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa189f9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+23:11650:x1874546707760128:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787707375.459218:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707759872 00000100:00100000:1.0:1787707375.459227:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707759872 00000100:00100000:1.0:1787707375.459338:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 231 00000100:00100000:1.0:1787707375.459349:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+25:11649:x1874546707759872:12345-192.168.204.46@tcp:58:lfs.0 00000040:00080000:1.0:1787707375.460178:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787707375.460279:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+25:11649:x1874546707759872:12345-192.168.204.46@tcp:58:lfs.0 Request processed in 930us (2591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707375.460288:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 231 00000004:00080000:3.0:1787707375.460473:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787707375.460608:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1787707375.460681:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec188e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.460697:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec188e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.460710:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec188e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.460730:0:5860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec188e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.460736:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec188e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.460742:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec188e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.460773:0:5860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787707375.460834:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa189f9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+25:11650:x1874546707760128:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 Request processed in 2813us (3083us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1787707375.460843:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 62 00000020:00080000:3.0:1787707375.460847:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787707375.461817:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707375.461827:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec188e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.461836:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa00030600 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707375.461840:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec188e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.461848:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec188e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.461865:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cfa143e4c00) 00010000:00010000:3.0:1787707375.461868:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787707375.461873:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec188e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.461893:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec188e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.461927:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707375.461929:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707375.461931:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707375.513279:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707375.513435:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707760256 00000100:00100000:3.0:1787707375.513445:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707760256 00000100:00100000:3.0:1787707375.513514:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 232 00000100:00100000:3.0:1787707375.513525:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa418ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+25:11652:x1874546707760256:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:3.0:1787707375.513551:0:12425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707375.513573:0:12425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec1895 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba024 expref: -99 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.513644:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec189c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.513660:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec189c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.513672:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec189c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.513687:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec18a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.513693:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec18a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.513698:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec18a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.515095:0:12425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec18aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.515112:0:12425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec17b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fe5 expref: 26 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.515120:0:12425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec18aa lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.515158:0:12425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec17b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fe5 expref: 26 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707375.515175:0:12425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec17b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fe5 expref: 26 pid: 5857 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707375.515191:0:12425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a555180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12425:1874546729767936:192.168.204.46@tcp:104: 00000100:00100000:3.0:1787707375.515282:0:12425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa30b2fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787707375.523437:0:12425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a555180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12425:1874546729767936:192.168.204.46@tcp:104: 00010000:00010000:3.0:1787707375.523471:0:12425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec18aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707375.525012:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707375.528101:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707760512 00000100:00100000:0.0:1787707375.528119:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707760512 00000100:00100000:0.0:1787707375.528271:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 63 00000100:00100000:0.0:1787707375.528284:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+27:5599:x1874546707760512:12345-192.168.204.46@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787707375.528600:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+28:5599:x1874546707760512:12345-192.168.204.46@tcp:35:ldlm_bl.0 Request processed in 318us (3593us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787707375.528609:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 63 00000100:00100000:3.0:1787707375.532848:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707375.532954:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707760640 00000100:00100000:1.0:1787707375.532965:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707760640 00010000:00010000:1.0:1787707375.533011:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec17b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fe5 expref: 28 pid: 5857 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707375.533052:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 85 00000100:00100000:1.0:1787707375.533062:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a555180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+28:2362:x1874546707760640:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787707375.533079:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707375.533100:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec17b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fe5 expref: 28 pid: 5857 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707375.533117:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec17b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fe5 expref: 28 pid: 5857 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707375.533140:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3200/0xc5f18d5f94ec17b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fe5 expref: 28 pid: 5857 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707375.533157:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:1.0:1787707375.533163:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec18aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707375.533172:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec18aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707375.533180:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec18aa lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707375.533220:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707375.533276:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a555180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+27:2362:x1874546707760640:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 214us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707375.533284:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 85 00010000:00010000:2.0:1787707375.533664:0:12425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec18aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.533685:0:12425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec18aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707375.533728:0:12425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787707375.533732:0:12425:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787707375.533750:0:12425:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec18aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.533764:0:12425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec18aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.533774:0:12425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec189c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.533781:0:12425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec189c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.533788:0:12425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec189c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.533794:0:12425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa00031c00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707375.533798:0:12425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec189c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.533806:0:12425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec189c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.533815:0:12425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:2.0:1787707375.533818:0:12425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707375.533822:0:12425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec189c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.533838:0:12425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031c00/0xc5f18d5f94ec189c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.533853:0:12425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec18a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.533859:0:12425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec18a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.533864:0:12425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec18a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.533869:0:12425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa00030800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707375.533872:0:12425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec18a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.533878:0:12425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec18a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.533886:0:12425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cfa143e4c00) 00010000:00010000:2.0:1787707375.533888:0:12425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707375.533891:0:12425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec18a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.533897:0:12425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030800/0xc5f18d5f94ec18a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.533933:0:12425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00030600/0xc5f18d5f94ec1895 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba024 expref: 27 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.533963:0:12425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec18aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba024 expref: 26 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707375.533970:0:12425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:2.0:1787707375.533973:0:12425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787707375.533975:0:12425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fca00, rc 0) 00000100:00100000:2.0:1787707375.534180:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa418ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+26:11652:x1874546707760256:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 20654us (20908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707375.534189:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 232 00010000:00010000:1.0:1787707375.866107:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787707376.373980:0:12570:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787707376.373989:0:12570:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787707376.374035:0:12570:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787707376.374040:0:12570:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787707376.505781:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787707376.505791:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787707376.505846:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787707376.505856:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787707376.505986:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c94700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874546729768064:192.168.204.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787707376.506095:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05e2da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787707376.509755:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707376.509858:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c94700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874546729768064:192.168.204.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787707376.510631:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707760768 00000100:00100000:3.0:1787707376.510647:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707760768 00000100:00100000:3.0:1787707376.510724:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 233 00000100:00100000:3.0:1787707376.510734:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+26:11664:x1874546707760768:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787707376.510772:0:8469:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787707376.510878:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+26:11664:x1874546707760768:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 Request processed in 145us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707376.510886:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 233 00000100:00100000:3.0:1787707376.516494:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707376.516536:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707376.516569:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707376.516608:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707376.516620:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707761024 00000100:00100000:1.0:1787707376.516629:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707761024 00000100:00100000:3.0:1787707376.516638:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707376.516657:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707761408 00000100:00100000:3.0:1787707376.516661:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707761408 00000100:00100000:1.0:1787707376.516672:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707761536 00000100:00100000:1.0:1787707376.516675:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707761536 00000100:00100000:3.0:1787707376.516692:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707761280 00000100:00100000:3.0:1787707376.516694:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707761280 00000100:00100000:1.0:1787707376.516696:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 183 00000100:00100000:1.0:1787707376.516705:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2360:x1874546707761536:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707376.516711:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 105 00000100:00100000:3.0:1787707376.516717:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2360:x1874546707761408:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707376.516780:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2360:x1874546707761536:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 76us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707376.516783:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707761152 00000100:00100000:0.0:1787707376.516787:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707761152 00000100:00100000:1.0:1787707376.516788:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 183 00000100:00100000:1.0:1787707376.516805:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 234 00000100:00100000:1.0:1787707376.516811:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+26:11664:x1874546707761024:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00000100:00100000:0.0:1787707376.516814:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 306 00000100:00100000:0.0:1787707376.516819:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa07315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+13:2360:x1874546707761152:12345-192.168.204.46@tcp:400:kworker.0 00010000:00010000:1.0:1787707376.516822:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707376.516842:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec18b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba02b expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707376.516944:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec18b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707376.516959:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec18b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707376.516971:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec18b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707376.516981:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787707376.517103:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec18b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba02b expref: 29 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707376.517120:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec18b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba02b expref: 28 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707376.517129:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:1.0:1787707376.517132:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787707376.517136:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a14200, rc 0) 00000100:00100000:3.0:1787707376.517188:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2360:x1874546707761408:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 469us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707376.517207:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 105 00000100:00100000:3.0:1787707376.517221:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 106 00000100:00100000:3.0:1787707376.517228:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2360:x1874546707761280:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707376.517254:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2360:x1874546707761280:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 26us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707376.517273:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 106 00000100:00100000:0.0:1787707376.519155:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa07315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+13:2360:x1874546707761152:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 2323us (2606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707376.519168:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 306 00000100:00080000:0.0:1787707376.519627:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787707376.519634:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787707376.520343:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+28:11664:x1874546707761024:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 3525us (3853us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787707376.520354:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 234 00000100:00100000:3.0:1787707376.526686:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707376.527494:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707376.528309:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707761920 00000100:00100000:0.0:1787707376.528322:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707761920 00000100:00100000:0.0:1787707376.528421:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 18 00000100:00100000:0.0:1787707376.528433:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa113ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+28:2361:x1874546707761920:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707376.528449:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707376.528480:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec18b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba02b expref: 28 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707376.528498:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:0.0:1787707376.528503:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707376.528568:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa113ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+27:2361:x1874546707761920:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 137us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707376.528575:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 18 00000100:00100000:2.0:1787707376.528628:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707761792 00000100:00100000:2.0:1787707376.528633:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707761792 00000100:00100000:2.0:1787707376.528672:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 235 00000100:00100000:2.0:1787707376.528681:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+27:11664:x1874546707761792:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787707376.528755:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec18c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707376.528770:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec18c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707376.528782:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec18c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707376.528968:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec18c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707376.528976:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec18c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707376.528991:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec18c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707376.528997:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871aa00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707376.529002:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec18c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707376.529010:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec18c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707376.529019:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:2.0:1787707376.529022:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787707376.529025:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec18c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707376.529030:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871aa00/0xc5f18d5f94ec18c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707376.529194:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+28:11664:x1874546707761792:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 Request processed in 513us (2516us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1787707376.529202:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 235 00000100:00100000:3.0:1787707376.535206:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707376.535249:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707762176 00000100:00100000:3.0:1787707376.535260:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707762176 00000100:00100000:3.0:1787707376.535333:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 64 00000100:00100000:3.0:1787707376.535345:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+28:11664:x1874546707762176:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787707376.535633:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+29:11664:x1874546707762176:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 Request processed in 289us (435us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787707376.535642:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 64 00000040:00080000:0.0:1787707376.535758:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787707376.535764:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787707376.536274:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787707376.536285:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787707376.888826:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707377.912481:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707377.977898:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729768192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787707377.977977:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707377.978052:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729768192 00000100:00100000:1.0:1787707377.978059:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729768192 00000100:00100000:1.0:1787707377.978135:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787707377.978145:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874546729768192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787707377.978185:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787707377.978233:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874546729768192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707377.978240:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1787707377.978257:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787707377.978295:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729768192:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787707378.304615:0:12622:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787707378.304625:0:12622:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787707378.304675:0:12622:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787707378.304683:0:12622:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787707378.500138:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707378.500297:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707762432 00000100:00100000:0.0:1787707378.500308:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707762432 00000100:00100000:0.0:1787707378.500492:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 236 00000100:00100000:0.0:1787707378.500504:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+29:11684:x1874546707762432:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:0.0:1787707378.500531:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707378.500569:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dac00/0xc5f18d5f94ec18cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba032 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707378.500679:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8da400/0xc5f18d5f94ec18d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707378.500694:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8da400/0xc5f18d5f94ec18d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707378.500709:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8da400/0xc5f18d5f94ec18d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707378.500720:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787707378.500854:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dac00/0xc5f18d5f94ec18cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba032 expref: 32 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707378.500872:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8da400/0xc5f18d5f94ec18d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba032 expref: 31 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707378.500881:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:0.0:1787707378.500885:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787707378.500888:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3f8da400, rc 0) 00000100:00100000:0.0:1787707378.500953:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+31:11684:x1874546707762432:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 452us (826us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787707378.500960:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 236 00000100:00080000:2.0:1787707378.501771:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707378.506530:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707378.506619:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707762560 00000100:00100000:1.0:1787707378.506630:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707762560 00000100:00100000:1.0:1787707378.506699:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 237 00000100:00100000:1.0:1787707378.506712:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+31:11684:x1874546707762560:12345-192.168.204.46@tcp:54:lfs.0 00010000:00010000:1.0:1787707378.506793:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec18e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707378.506817:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec18e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707378.506828:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec18e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707378.506857:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec18e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707378.506876:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec18e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707378.506883:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec18e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707378.506889:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707378.506894:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec18e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707378.506901:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec18e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707378.506913:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:1.0:1787707378.506916:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787707378.506920:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec18e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707378.506926:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15400/0xc5f18d5f94ec18e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707378.507009:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+31:11684:x1874546707762560:12345-192.168.204.46@tcp:54:lfs.0 Request processed in 300us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707378.507017:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 237 00000100:00100000:3.0:1787707378.632746:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707378.633022:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707762688 00000100:00100000:2.0:1787707378.633034:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707762688 00000100:00100000:2.0:1787707378.633191:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 71 00000100:00100000:2.0:1787707378.633205:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08770000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2361:x1874546707762688:12345-192.168.204.46@tcp:101:cat.0 00010000:00010000:2.0:1787707378.633223:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707378.633253:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cca50419/0xc5f18d5f94ec18e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba039 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787707378.633299:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8e3fed, atime: 0x6a8e3fed, ctime: 0x6a8e3fed, blocks: 0xb 00010000:00010000:2.0:1787707378.633319:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=429s v=(0 0) 00010000:00010000:2.0:1787707378.633324:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707378.633334:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cca50419/0xc5f18d5f94ec18e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba039 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707378.633355:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cca50419/0xc5f18d5f94ec18e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba039 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707378.633409:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871b600, rc 0) 00000100:00100000:2.0:1787707378.633480:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08770000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2361:x1874546707762688:12345-192.168.204.46@tcp:101:cat.0 Request processed in 280us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707378.633487:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 71 00000100:00080000:3.0:1787707378.633939:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787707378.639672:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707378.639957:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707762816 00000100:00100000:1.0:1787707378.639969:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707762816 00002000:00100000:1.0:1787707378.640023:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8cfa08773b80 x1874546707762816/t0(0) o3->9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp:269/0 lens 488/0 e 0 to 0 dl 1787707389 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787707378.640036:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa08773b80 with x1874546707762816 ext(0->4095) 00002000:00010000:1.0:1787707378.640054:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfa08773b80 00000100:00100000:1.0:1787707378.640106:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 7 00000100:00100000:1.0:1787707378.640118:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2362:x1874546707762816:12345-192.168.204.46@tcp:3:cat.0 00000100:00100000:1.0:1787707378.640585:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+8:2362:x1874546707762816:12345-192.168.204.46@tcp:3:cat.0 Request processed in 467us (920us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787707378.640594:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 7 00002000:00100000:1.0:1787707378.640602:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8cfa08773b80 x1874546707762816/t0(0) o3->9ed4058d-c366-401f-b84d-540fc0489f0c@192.168.204.46@tcp:269/0 lens 488/4536 e 0 to 0 dl 1787707389 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787707378.640611:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfa08773b80 with x1874546707762816 ext(0->4095) 00002000:00010000:1.0:1787707378.640614:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfa08773b80 00010000:00010000:1.0:1787707378.936707:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707379.961679:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707380.028182:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08771180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729768320:0@lo:400:kworker.0 00000100:00100000:1.0:1787707380.028308:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707380.028428:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729768832:0@lo:400:kworker.0 00000100:00100000:1.0:1787707380.028488:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707380.028528:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787707380.028536:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08770380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729768448:0@lo:400:kworker.0 00000100:00100000:1.0:1787707380.028564:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707380.028583:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729768960:0@lo:400:kworker.0 00000100:00100000:1.0:1787707380.028613:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707380.028651:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08772a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729768704:0@lo:400:kworker.0 00000100:00100000:0.0:1787707380.028673:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729768320 00000100:00100000:1.0:1787707380.028683:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707380.028686:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729768320 00000100:00100000:1.0:1787707380.028723:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729768832 00000100:00100000:1.0:1787707380.028737:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729768832 00000100:00100000:0.0:1787707380.028768:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787707380.028784:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729768320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707380.028791:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787707380.028803:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729768832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707380.028906:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729768576:0@lo:400:kworker.0 00000100:00100000:1.0:1787707380.028944:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729768832:12345-0@lo:400:kworker.0 Request processed in 144us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707380.028952:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787707380.028970:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729768448 00000100:00100000:1.0:1787707380.028973:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729768448 00000100:00100000:1.0:1787707380.028993:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787707380.028997:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729768448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707380.029179:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707380.029220:0:12022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729768960 00000100:00100000:3.0:1787707380.029225:0:12022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729768960 00000100:00100000:3.0:1787707380.029264:0:12022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729768704 00000100:00100000:3.0:1787707380.029268:0:12022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729768704 00000100:00100000:3.0:1787707380.029294:0:12022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787707380.029301:0:12022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3314:x1874546729768960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707380.029680:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729768320:12345-0@lo:400:kworker.0 Request processed in 899us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707380.029686:0:12022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3314:x1874546729768960:12345-0@lo:400:kworker.0 Request processed in 385us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707380.029701:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787707380.029711:0:12022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787707380.029729:0:12022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787707380.029737:0:12022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f68b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3317:x1874546729768704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707380.029797:0:12022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f68b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3317:x1874546729768704:12345-0@lo:400:kworker.0 Request processed in 61us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707380.029803:0:12022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1787707380.029822:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787707380.029828:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787707380.029837:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707380.029850:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729768576 00000100:00100000:3.0:1787707380.029854:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729768576 00000100:00100000:1.0:1787707380.029958:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729768448:12345-0@lo:400:kworker.0 Request processed in 959us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707380.029967:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787707380.030196:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787707380.030204:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729768576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707380.030208:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08772a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729768704:0@lo:400:kworker.0 00000100:00100000:3.0:1787707380.030252:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729768576:12345-0@lo:400:kworker.0 Request processed in 49us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707380.030259:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787707380.030302:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729768576:0@lo:400:kworker.0 00000100:00100000:1.0:1787707380.030394:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08770380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729768448:0@lo:400:kworker.0 00000100:00100000:1.0:1787707380.030412:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729768960:0@lo:400:kworker.0 00000100:00100000:1.0:1787707380.030425:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08771180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729768320:0@lo:400:kworker.0 00000100:00100000:1.0:1787707380.030437:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729768832:0@lo:400:kworker.0 00000100:00080000:0.0:1787707380.030638:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1787707380.152803:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:3.0:1787707380.538561:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729769088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787707380.538673:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707380.538787:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729769088 00000100:00100000:3.0:1787707380.538799:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729769088 00000100:00100000:3.0:1787707380.538864:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787707380.538876:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729769088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787707380.538923:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707380.538977:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729769088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707380.539000:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787707380.539050:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787707380.539057:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfa059b3480, transno 4294967310 00000100:00100000:3.0:1787707380.539078:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729769088:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1787707380.604679:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1787707380.604701:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1787707380.617902:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1787707380.617942:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1787707380.617982:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cfa41900d80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787707380.617990:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfa41932400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cfa41900cc0 00000020:00080000:1.0:1787707380.617993:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfa41932d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cfa3f94c800 00000020:00080000:2.0:1787707380.618051:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787707380.618419:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1787707380.984720:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707381.643729:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707381.643799:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707381.644338:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707762944 00000100:00100000:2.0:1787707381.644353:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707762944 00000100:00100000:2.0:1787707381.644478:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 308 00000100:00100000:2.0:1787707381.644490:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:2361:x1874546707762944:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707381.644592:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f5ae37-220d-45d9-b012-b91715df156e+13:2361:x1874546707762944:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 104us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707381.644602:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 308 00000100:00100000:2.0:1787707381.645553:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707381.645591:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707381.645877:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707763072 00000100:00100000:0.0:1787707381.645890:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707763072 00000100:00100000:1.0:1787707381.645892:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707763328 00000100:00100000:1.0:1787707381.645896:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707763328 00000100:00100000:0.0:1787707381.645960:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 187 00000100:00100000:0.0:1787707381.645971:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+18:2361:x1874546707763072:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707381.646006:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707763200 00000100:00100000:1.0:1787707381.646009:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707763200 00000100:00100000:1.0:1787707381.646037:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 109 00000100:00100000:1.0:1787707381.646045:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2362:x1874546707763328:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707381.646052:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+18:2361:x1874546707763072:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 84us (2252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707381.646059:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 187 00000100:00100000:1.0:1787707381.646073:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2362:x1874546707763328:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 31us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707381.646081:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 109 00000100:00100000:1.0:1787707381.646098:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 110 00000100:00100000:1.0:1787707381.646105:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2362:x1874546707763200:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707381.646134:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2362:x1874546707763200:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 29us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707381.646140:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 110 00000100:00080000:0.0:1787707381.646322:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787707381.646328:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787707381.646331:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787707381.646338:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707381.646521:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707763456 00000100:00100000:1.0:1787707381.646526:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707763456 00000100:00100000:1.0:1787707381.646561:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 188 00000100:00100000:1.0:1787707381.647086:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2362:x1874546707763456:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707381.647137:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2362:x1874546707763456:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 570us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707381.647144:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 188 00000100:00080000:1.0:1787707381.653512:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787707382.010664:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707383.034412:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707383.096536:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787707383.096563:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f68a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729769216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787707383.096633:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707383.096753:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729769216 00000100:00100000:1.0:1787707383.096763:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729769216 00000100:00100000:1.0:1787707383.096829:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787707383.096839:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729769216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787707383.096885:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787707383.096943:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729769216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707383.096950:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787707383.096973:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1787707383.096979:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1787707383.097008:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f68a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729769216:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787707383.097013:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787707383.826685:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707383.826779:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707763584 00000100:00100000:3.0:1787707383.826789:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707763584 00000100:00100000:3.0:1787707383.826872:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 238 00000100:00100000:3.0:1787707383.826883:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+18:11329:x1874546707763584:12345-192.168.204.46@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787707383.827008:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+18:11329:x1874546707763584:12345-192.168.204.46@tcp:60:lhsmtool_posix.0 Request processed in 127us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707383.827015:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 238 00000100:00080000:2.0:1787707383.827169:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707383.828892:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707383.829362:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707763840 00000100:00100000:3.0:1787707383.829407:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707763840 00000100:00100000:3.0:1787707383.829454:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 65 00000100:00100000:3.0:1787707383.829462:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+18:11329:x1874546707763840:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787707383.829947:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+19:11329:x1874546707763840:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 Request processed in 484us (1061us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787707383.829957:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 65 00010000:00010000:3.0:1787707384.056580:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707384.100027:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707384.100446:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707763968 00000100:00100000:0.0:1787707384.100456:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707763968 00000100:00100000:0.0:1787707384.100577:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 239 00000100:00100000:0.0:1787707384.100589:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f68a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:12135:x1874546707763968:12345-192.168.204.46@tcp:101:lsof.0 00010000:00010000:0.0:1787707384.100610:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707384.100632:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8db200/0xc5f18d5f94ec18f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba040 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787707384.100845:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787707384.100943:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dbc00/0xc5f18d5f94ec18f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707384.100958:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dbc00/0xc5f18d5f94ec18f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707384.100985:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dbc00/0xc5f18d5f94ec18f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707384.101350:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787707384.101355:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787707384.101471:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dbc00/0xc5f18d5f94ec18f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707384.101501:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8db200/0xc5f18d5f94ec18f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba040 expref: 7 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707384.101519:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dbc00/0xc5f18d5f94ec18f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba040 expref: 6 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707384.101528:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:0.0:1787707384.101531:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787707384.101535:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3f8dbc00, rc 0) 00000100:00100000:0.0:1787707384.101802:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f68a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+6:12135:x1874546707763968:12345-192.168.204.46@tcp:101:lsof.0 Request processed in 1214us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707384.101810:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 239 00010000:00010000:0.0:1787707385.081414:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707385.147744:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729769600:0@lo:400:kworker.0 00000100:00100000:1.0:1787707385.147821:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707385.147899:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729769600 00000100:00100000:1.0:1787707385.147908:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729769600 00000100:00100000:2.0:1787707385.147949:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729769728:0@lo:400:kworker.0 00000100:00100000:1.0:1787707385.147966:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787707385.147979:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729769600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707385.147991:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787707385.148036:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787707385.148043:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729769600:12345-0@lo:400:kworker.0 Request processed in 66us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707385.148052:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787707385.148098:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729769600:0@lo:400:kworker.0 00000100:00100000:0.0:1787707385.148190:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729769344:0@lo:400:kworker.0 00000100:00100000:0.0:1787707385.148225:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707385.148269:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729769856:0@lo:400:kworker.0 00000100:00100000:0.0:1787707385.148292:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707385.148321:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787707385.148327:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729769472:0@lo:400:kworker.0 00000100:00100000:0.0:1787707385.148358:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707385.148398:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729769984:0@lo:400:kworker.0 00000100:00100000:2.0:1787707385.148407:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729769856 00000100:00100000:2.0:1787707385.148412:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729769856 00000100:00100000:0.0:1787707385.148423:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707385.148456:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729769472 00000100:00100000:2.0:1787707385.148460:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729769472 00000100:00100000:2.0:1787707385.148484:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787707385.148492:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729769856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707385.148641:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787707385.148651:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729769472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707385.148689:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729769472:12345-0@lo:400:kworker.0 Request processed in 40us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707385.148695:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787707385.148724:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729769472:0@lo:400:kworker.0 00000100:00080000:0.0:1787707385.148747:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787707385.149009:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729769856:12345-0@lo:400:kworker.0 Request processed in 517us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707385.149016:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729769728 00000100:00100000:2.0:1787707385.149020:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787707385.149023:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729769728 00000100:00100000:3.0:1787707385.149074:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729769984 00000100:00100000:3.0:1787707385.149078:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729769984 00000100:00100000:3.0:1787707385.149098:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787707385.149105:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729769728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707385.149158:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729769728:12345-0@lo:400:kworker.0 Request processed in 53us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707385.149165:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787707385.149189:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787707385.149196:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729769984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707385.149225:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729769984:12345-0@lo:400:kworker.0 Request processed in 30us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707385.149232:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787707385.150007:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729769728:0@lo:400:kworker.0 00000100:00080000:0.0:1787707385.150463:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787707385.150469:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787707385.150503:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729769984:0@lo:400:kworker.0 00000100:00100000:0.0:1787707385.150516:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729769856:0@lo:400:kworker.0 00000100:00100000:1.0:1787707385.150826:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729769344 00000100:00100000:1.0:1787707385.150833:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729769344 00000100:00100000:1.0:1787707385.150884:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787707385.150893:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729769344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707385.150961:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729769344:12345-0@lo:400:kworker.0 Request processed in 68us (2733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707385.150969:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1787707385.151700:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729769344:0@lo:400:kworker.0 00000100:00100000:2.0:1787707385.656689:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787707385.656713:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729770112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787707385.656793:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707385.657101:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729770112 00000100:00100000:1.0:1787707385.657110:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729770112 00000100:00100000:1.0:1787707385.657157:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787707385.657167:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729770112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787707385.657212:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787707385.657269:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729770112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707385.657276:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787707385.670943:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729770112:0@lo:13:osp-pre-1-0.0 00000020:00080000:1.0:1787707385.733834:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:1.0:1787707385.733868:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1787707385.735221:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787707385.735249:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1787707386.104678:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707386.764715:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707386.764764:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707386.764790:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707386.764815:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707386.764850:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707386.764876:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707764096 00000100:00100000:0.0:1787707386.764887:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707764096 00000100:00100000:0.0:1787707386.764939:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 310 00000100:00100000:0.0:1787707386.764951:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:2361:x1874546707764096:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707386.765048:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+13:2361:x1874546707764096:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 99us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707386.765058:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 310 00000100:00100000:0.0:1787707386.765092:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707764224 00000100:00100000:0.0:1787707386.765096:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707764224 00000100:00100000:0.0:1787707386.765131:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707764608 00000100:00100000:0.0:1787707386.765134:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707764608 00000100:00100000:0.0:1787707386.765154:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 192 00000100:00100000:0.0:1787707386.765159:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+18:2361:x1874546707764224:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707386.765193:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+18:2361:x1874546707764224:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 33us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707386.765200:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 192 00000100:00100000:0.0:1787707386.765228:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 193 00000100:00100000:0.0:1787707386.765236:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+6:2361:x1874546707764608:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707386.765261:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+6:2361:x1874546707764608:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 27us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707386.765267:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 193 00000100:00100000:2.0:1787707386.765300:0:12022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707764480 00000100:00100000:2.0:1787707386.765305:0:12022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707764480 00000100:00100000:2.0:1787707386.765343:0:12022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707764352 00000100:00100000:2.0:1787707386.765347:0:12022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707764352 00000100:00100000:2.0:1787707386.765402:0:12022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 113 00000100:00100000:2.0:1787707386.765414:0:12022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2361:x1874546707764480:12345-192.168.204.46@tcp:400:kworker.0 00000100:00080000:0.0:1787707386.765429:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787707386.765434:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787707386.765438:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787707386.765464:0:12022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2361:x1874546707764480:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 54us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707386.765473:0:12022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 113 00000100:00100000:2.0:1787707386.765493:0:12022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 114 00000100:00100000:2.0:1787707386.765500:0:12022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2361:x1874546707764352:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707386.765537:0:12022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2361:x1874546707764352:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 38us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707386.765544:0:12022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 114 00000040:00080000:0.0:1787707386.809179:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787707386.809189:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787707386.812180:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:0.0:1787707386.812201:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787707387.129859:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787707387.538546:0:12827:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 21:23:04 (1787707384) 00010000:00010000:0.0:1787707388.153606:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707388.222347:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729770240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787707388.222438:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707388.222519:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729770240 00000100:00100000:1.0:1787707388.222527:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729770240 00000100:00100000:1.0:1787707388.222584:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787707388.222595:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729770240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787707388.222634:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787707388.222681:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729770240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707388.222688:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1787707388.222709:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787707388.222746:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729770240:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787707389.176732:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707390.201247:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707390.266055:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729770624:0@lo:400:kworker.0 00000100:00100000:0.0:1787707390.266126:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707390.266204:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787707390.266211:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729770752:0@lo:400:kworker.0 00000100:00100000:0.0:1787707390.266238:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707390.266331:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729770368:0@lo:400:kworker.0 00000100:00100000:1.0:1787707390.266402:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707390.266424:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729770880:0@lo:400:kworker.0 00000100:00100000:1.0:1787707390.266446:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707390.266460:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787707390.266465:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729770496:0@lo:400:kworker.0 00000100:00100000:1.0:1787707390.266507:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707390.266535:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729771008:0@lo:400:kworker.0 00000100:00100000:1.0:1787707390.266555:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707390.266582:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729770624 00000100:00100000:1.0:1787707390.266590:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729770624 00000100:00100000:1.0:1787707390.266636:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729770880 00000100:00100000:1.0:1787707390.266639:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729770880 00000100:00100000:1.0:1787707390.266657:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729770496 00000100:00100000:1.0:1787707390.266659:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729770496 00000100:00100000:1.0:1787707390.266674:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787707390.266682:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729770624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707390.266732:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729770624:12345-0@lo:400:kworker.0 Request processed in 51us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707390.266740:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787707390.266757:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787707390.266762:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729770880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707390.266793:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729770880:12345-0@lo:400:kworker.0 Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707390.266799:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787707390.266810:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787707390.266815:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729770496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707390.266840:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729770496:12345-0@lo:400:kworker.0 Request processed in 25us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707390.266845:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787707390.266861:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729770752 00000100:00100000:1.0:1787707390.266864:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729770752 00000100:00100000:1.0:1787707390.266889:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729771008 00000100:00100000:1.0:1787707390.266897:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729771008 00000100:00100000:1.0:1787707390.266921:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787707390.266926:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729770752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707390.266954:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729770752:12345-0@lo:400:kworker.0 Request processed in 28us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707390.266960:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787707390.266970:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787707390.266975:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729771008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707390.267000:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729771008:12345-0@lo:400:kworker.0 Request processed in 25us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707390.267005:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:1.0:1787707390.267022:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787707390.267026:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787707390.267028:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787707390.267063:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729770496:0@lo:400:kworker.0 00000100:00100000:1.0:1787707390.267073:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729771008:0@lo:400:kworker.0 00000100:00100000:1.0:1787707390.267082:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729770880:0@lo:400:kworker.0 00000100:00100000:0.0:1787707390.267748:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729770368 00000100:00100000:0.0:1787707390.267755:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729770368 00000100:00100000:0.0:1787707390.267797:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787707390.267806:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729770368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707390.267858:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729770368:12345-0@lo:400:kworker.0 Request processed in 54us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707390.267864:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787707390.267913:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729770752:0@lo:400:kworker.0 00000100:00100000:0.0:1787707390.267924:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729770624:0@lo:400:kworker.0 00000100:00100000:3.0:1787707390.267999:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729770368:0@lo:400:kworker.0 00000100:00100000:0.0:1787707390.776975:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787707390.776999:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729771136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787707390.777075:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707390.777165:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729771136 00000100:00100000:0.0:1787707390.777172:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729771136 00000100:00100000:0.0:1787707390.777222:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787707390.777232:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729771136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787707390.777280:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707390.777326:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729771136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707390.777346:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787707390.777433:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729771136:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787707391.225755:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707391.876364:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707391.876443:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707391.876483:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707391.876514:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707391.876606:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707391.876641:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707765120 00000100:00100000:0.0:1787707391.876650:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707765120 00000100:00100000:0.0:1787707391.876707:0:8265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707764992 00000100:00100000:0.0:1787707391.876710:0:8265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707764992 00000100:00100000:0.0:1787707391.876754:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 117 00000100:00100000:0.0:1787707391.876765:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2359:x1874546707765120:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707391.876837:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2359:x1874546707765120:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 73us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707391.876845:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 117 00000100:00100000:0.0:1787707391.876864:0:8265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 118 00000100:00100000:0.0:1787707391.876870:0:8265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2359:x1874546707764992:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707391.876895:0:8265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2359:x1874546707764992:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 25us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707391.876901:0:8265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 118 00000100:00100000:0.0:1787707391.876919:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707764864 00000100:00100000:0.0:1787707391.876923:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707764864 00000100:00100000:0.0:1787707391.876946:0:12425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707765248 00000100:00100000:0.0:1787707391.876949:0:12425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707765248 00000100:00100000:0.0:1787707391.876966:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 197 00000100:00100000:0.0:1787707391.876972:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+18:2360:x1874546707764864:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707391.877008:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+18:2360:x1874546707764864:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 36us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707391.877014:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 197 00000100:00100000:0.0:1787707391.877025:0:12425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 198 00000100:00100000:0.0:1787707391.877031:0:12425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+6:2359:x1874546707765248:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707391.877050:0:12425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+6:2359:x1874546707765248:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 19us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707391.877055:0:12425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 198 00000100:00100000:1.0:1787707391.877473:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707764736 00000100:00100000:1.0:1787707391.877478:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707764736 00000100:00100000:1.0:1787707391.877516:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 312 00000100:00100000:1.0:1787707391.877524:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+13:2360:x1874546707764736:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707391.877569:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f5ae37-220d-45d9-b012-b91715df156e+13:2360:x1874546707764736:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 46us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707391.877576:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 312 00000100:00080000:1.0:1787707391.877605:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787707391.877618:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787707391.877620:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787707392.248635:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707392.535815:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707392.536668:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707765504 00000100:00100000:3.0:1787707392.536680:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707765504 00000100:00100000:3.0:1787707392.536758:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 66 00000100:00100000:3.0:1787707392.536777:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+18:12357:x1874546707765504:12345-192.168.204.46@tcp:35:umount.0 00000100:00100000:3.0:1787707392.537340:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+19:12357:x1874546707765504:12345-192.168.204.46@tcp:35:umount.0 Request processed in 563us (1534us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787707392.537348:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 66 00000100:00100000:2.0:1787707392.542229:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707392.542677:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707765760 00000100:00100000:3.0:1787707392.542687:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707765760 00000100:00100000:3.0:1787707392.542751:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 67 00000100:00100000:3.0:1787707392.542761:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+19:12357:x1874546707765760:12345-192.168.204.46@tcp:35:umount.0 00000100:00100000:3.0:1787707392.543359:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+20:12357:x1874546707765760:12345-192.168.204.46@tcp:35:umount.0 Request processed in 597us (1137us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787707392.543395:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 67 00000100:00100000:1.0:1787707392.547182:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707392.547340:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707766016 00000100:00100000:0.0:1787707392.547349:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707766016 00000100:00100000:0.0:1787707392.547432:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 68 00000100:00100000:0.0:1787707392.547453:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa189f9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+20:12357:x1874546707766016:12345-192.168.204.46@tcp:35:umount.0 00000100:00100000:0.0:1787707392.548219:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa189f9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ed4058d-c366-401f-b84d-540fc0489f0c+21:12357:x1874546707766016:12345-192.168.204.46@tcp:35:umount.0 Request processed in 775us (1044us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787707392.548229:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 68 00000100:00100000:0.0:1787707392.560996:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707392.561231:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707766272 00000100:00100000:3.0:1787707392.561241:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707766272 00000100:00100000:3.0:1787707392.561303:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 69 00000100:00100000:3.0:1787707392.561312:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+21:12357:x1874546707766272:12345-192.168.204.46@tcp:35:umount.0 00000100:00100000:3.0:1787707392.561824:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ed4058d-c366-401f-b84d-540fc0489f0c+22:12357:x1874546707766272:12345-192.168.204.46@tcp:35:umount.0 Request processed in 510us (847us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1787707392.561831:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 69 00000100:00100000:2.0:1787707392.568733:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707392.568884:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707766400 00000100:00100000:3.0:1787707392.568894:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707766400 00000100:00100000:3.0:1787707392.568985:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 19 00000100:00100000:3.0:1787707392.568996:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f156680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60f5ae37-220d-45d9-b012-b91715df156e+13:2361:x1874546707766400:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787707392.569013:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707392.569036:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa08747400/0xc5f18d5f94ec096f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9bcb expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707392.569051:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707392.569225:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f156680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60f5ae37-220d-45d9-b012-b91715df156e+12:2361:x1874546707766400:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 231us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707392.569233:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 19 00000100:00100000:1.0:1787707392.569321:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707392.569513:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707766528 00000100:00100000:3.0:1787707392.569518:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707766528 00000100:00100000:3.0:1787707392.569555:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 20 00000100:00100000:3.0:1787707392.569562:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f151f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60f5ae37-220d-45d9-b012-b91715df156e+12:2361:x1874546707766528:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787707392.569586:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707392.569599:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa3fcd3600/0xc5f18d5f94ec08d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9b93 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707392.569609:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707392.569632:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f151f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60f5ae37-220d-45d9-b012-b91715df156e+11:2361:x1874546707766528:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 70us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707392.569639:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 20 00000100:00100000:1.0:1787707392.570996:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707392.571067:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707766656 00000100:00100000:3.0:1787707392.571075:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707766656 00000100:00100000:3.0:1787707392.571134:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 21 00000100:00100000:3.0:1787707392.571143:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f153480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60f5ae37-220d-45d9-b012-b91715df156e+11:2359:x1874546707766656:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787707392.571155:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707392.571171:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa0871ac00/0xc5f18d5f94ec0b83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c96 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707392.571186:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707392.571234:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f153480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60f5ae37-220d-45d9-b012-b91715df156e+10:2359:x1874546707766656:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 92us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707392.571241:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 21 00000100:00100000:2.0:1787707392.578113:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707392.578407:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707766784 00000100:00100000:1.0:1787707392.578417:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707766784 00000100:00100000:1.0:1787707392.578476:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 72 00000100:00100000:1.0:1787707392.578486:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+5:2358:x1874546707766784:12345-192.168.204.46@tcp:9:umount.0 00000020:00000080:1.0:1787707392.578519:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec0c47 00000100:00080000:1.0:1787707392.578531:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8cfa05840000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787707392.578575:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1787707392.578749:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707392.579238:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+2:2358:x1874546707766784:12345-192.168.204.46@tcp:9:umount.0 Request processed in 750us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707392.579247:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 72 00000100:00100000:1.0:1787707392.594991:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707392.595286:0:12022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707767168 00000100:00100000:3.0:1787707392.595296:0:12022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707767168 00000100:00100000:3.0:1787707392.595356:0:12022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 73 00000100:00100000:3.0:1787707392.595367:0:12022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+7:2358:x1874546707767168:12345-192.168.204.46@tcp:9:umount.0 00000020:00000080:3.0:1787707392.595430:0:12022:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec0eaf 00000020:00010000:3.0:1787707392.595441:0:12022:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cfa18484000: total 0 00000100:00080000:3.0:1787707392.595458:0:12022:0:(import.c:65:import_set_state_nolock()) ffff8cfa18483000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787707392.595496:0:12022:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:0.0:1787707392.595799:0:5845:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cfa18484000: total 0 00010000:00010000:0.0:1787707392.595836:0:5845:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cfa18484000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787707392.595888:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec124b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e6b expref: 6 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707392.595938:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cca50419/0xc5f18d5f94ec18e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba039 expref: 5 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707392.595971:0:5845:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cfa18484000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787707392.595994:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707392.595996:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707392.595998:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707392.596496:0:12022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ed4058d-c366-401f-b84d-540fc0489f0c+2:2358:x1874546707767168:12345-192.168.204.46@tcp:9:umount.0 Request processed in 1127us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707392.596506:0:12022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 73 00000100:00100000:2.0:1787707392.619887:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707392.619999:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707768192 00000100:00100000:0.0:1787707392.620010:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707768192 00000100:00100000:0.0:1787707392.620074:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 240 00000100:00100000:0.0:1787707392.620085:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+22:2358:x1874546707768192:12345-192.168.204.46@tcp:39:umount.0 00000020:00000080:0.0:1787707392.620127:0:5858:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec08e3 00000020:00010000:0.0:1787707392.620145:0:5858:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cf9012d1000: total 0 00000100:00080000:0.0:1787707392.620149:0:5858:0:(import.c:65:import_set_state_nolock()) ffff8cfa419d4000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787707392.620180:0:5858:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1787707392.620366:0:7630:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cf9012d1000: total 0 00010000:00010000:3.0:1787707392.620448:0:7630:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cf9012d1000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787707392.620481:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:3.0:1787707392.620485:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787707392.620493:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a000/0xc5f18d5f94ec0c1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cc0 expref: 23 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707392.620513:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:3.0:1787707392.620516:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787707392.620520:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa00031200/0xc5f18d5f94ec17ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9fec expref: 22 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707392.620534:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:3.0:1787707392.620536:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787707392.620539:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15000/0xc5f18d5f94ec12c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e8e expref: 19 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707392.620550:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:3.0:1787707392.620552:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787707392.620554:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2600/0xc5f18d5f94ec112c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e1e expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707392.620566:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfa06897a00) 00000100:00100000:0.0:1787707392.620575:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ed4058d-c366-401f-b84d-540fc0489f0c+17:2358:x1874546707768192:12345-192.168.204.46@tcp:39:umount.0 Request processed in 492us (698us total) trans 4294967525 rc 0/0 00010000:00010000:3.0:1787707392.620581:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787707392.620582:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 240 00010000:00010000:3.0:1787707392.620586:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5400/0xc5f18d5f94ec0bc9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9cab expref: 17 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707392.620606:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:3.0:1787707392.620608:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787707392.620612:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b200/0xc5f18d5f94ec12ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e87 expref: 15 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707392.620623:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:3.0:1787707392.620625:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787707392.620628:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8da400/0xc5f18d5f94ec18d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba032 expref: 14 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707392.628775:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:2.0:1787707392.628786:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787707392.628799:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd200/0xc5f18d5f94ec120c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e56 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707392.628839:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cfa19f4e800) 00010000:00010000:2.0:1787707392.628861:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787707392.628867:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1236 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9e64 expref: 12 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707392.628890:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cfa12a49400) 00010000:00010000:2.0:1787707392.628892:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787707392.628896:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fca00/0xc5f18d5f94ec18aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba024 expref: 11 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707392.628915:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cfa12a49300) 00010000:00010000:2.0:1787707392.628917:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787707392.628921:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3400/0xc5f18d5f94ec0f0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9d92 expref: 10 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707392.628935:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cfa12a49100) 00010000:00010000:2.0:1787707392.628938:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787707392.628941:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a200/0xc5f18d5f94ec0bad lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9ca4 expref: 9 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707392.628956:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cfa204c6200) 00010000:00010000:2.0:1787707392.628958:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787707392.628963:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15c00/0xc5f18d5f94ec15a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9f60 expref: 8 pid: 12425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707392.629114:0:7630:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cf9012d1000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1787707392.629147:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707392.629149:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707392.629152:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707393.272692:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707393.336895:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787707393.336934:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729771264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787707393.337021:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707393.337070:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729771264 00000100:00100000:0.0:1787707393.337078:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729771264 00000100:00100000:0.0:1787707393.337157:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787707393.337167:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729771264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787707393.337206:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787707393.337473:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787707393.337562:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729771264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 396us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707393.337570:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787707393.340095:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729771264:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787707394.298787:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707394.593337:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707394.593422:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707394.593478:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707394.593574:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707768320 00000100:00100000:1.0:1787707394.593584:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707768320 00000100:00100000:1.0:1787707394.593649:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707768576 00000100:00100000:1.0:1787707394.593653:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707768576 00000100:00100000:1.0:1787707394.593665:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707768448 00000100:00100000:1.0:1787707394.593668:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707768448 00000100:00100000:1.0:1787707394.593683:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 22 00000100:00100000:1.0:1787707394.593691:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60f5ae37-220d-45d9-b012-b91715df156e+12:2361:x1874546707768320:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787707394.593706:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707394.593726:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa00031e00/0xc5f18d5f94ec09b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9be0 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707394.593757:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707394.593811:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60f5ae37-220d-45d9-b012-b91715df156e+11:2361:x1874546707768320:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 120us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707394.593819:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 22 00000100:00100000:1.0:1787707394.593837:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 23 00000100:00100000:1.0:1787707394.593844:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60f5ae37-220d-45d9-b012-b91715df156e+10:2361:x1874546707768576:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787707394.593850:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707394.593860:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa0871a400/0xc5f18d5f94ec0b7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c8f expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707394.593869:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707394.593887:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60f5ae37-220d-45d9-b012-b91715df156e+9:2361:x1874546707768576:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 44us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707394.593893:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 23 00000100:00100000:1.0:1787707394.593908:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 24 00000100:00100000:1.0:1787707394.593913:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60f5ae37-220d-45d9-b012-b91715df156e+8:2361:x1874546707768448:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787707394.593919:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707394.593928:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa00030000/0xc5f18d5f94ec09bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9c0a expref: 8 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707394.593937:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787707394.593953:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60f5ae37-220d-45d9-b012-b91715df156e+7:2361:x1874546707768448:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 40us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707394.593959:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 24 00000100:00100000:2.0:1787707394.596588:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707394.596742:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707768832 00000100:00100000:0.0:1787707394.596753:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707768832 00000100:00100000:0.0:1787707394.596821:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 241 00000100:00100000:0.0:1787707394.596832:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+6:2358:x1874546707768832:12345-192.168.204.46@tcp:39:umount.0 00000020:00000080:0.0:1787707394.596869:0:8469:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec09ca 00000020:00010000:0.0:1787707394.596878:0:8469:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cfa2f342000: total 0 00000100:00080000:0.0:1787707394.596882:0:8469:0:(import.c:65:import_set_state_nolock()) ffff8cfa2f345000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787707394.596917:0:8469:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1787707394.597184:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07fb5f38-6916-4d1b-963f-1397d7cf8aaf+5:2358:x1874546707768832:12345-192.168.204.46@tcp:39:umount.0 Request processed in 353us (607us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787707394.597192:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 241 00000100:00080000:1.0:1787707394.597367:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1787707394.598033:0:7630:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cfa2f342000: total 0 00010000:00010000:3.0:1787707394.598039:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707394.598095:0:7630:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cfa2f342000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787707394.598129:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49700) 00010000:00010000:3.0:1787707394.598133:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787707394.598142:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3f8dbc00/0xc5f18d5f94ec18f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba040 expref: 4 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707394.598166:0:7630:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cfa2f342000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787707394.598176:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707394.598178:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707394.598180:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707394.637273:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707394.640008:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707769088 00000100:00100000:1.0:1787707394.640026:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707769088 00000100:00100000:1.0:1787707394.640117:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 313 00000100:00100000:1.0:1787707394.640129:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+7:2358:x1874546707769088:12345-192.168.204.46@tcp:251:umount.0 00000020:00000080:1.0:1787707394.640177:0:5848:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec08c0 00000020:00010000:1.0:1787707394.640186:0:5848:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cfa05846800: total 0 00000100:00080000:1.0:1787707394.640190:0:5848:0:(import.c:65:import_set_state_nolock()) ffff8cfa05842000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1787707394.640256:0:5844:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cfa05846800: total 0 00000100:00100000:1.0:1787707394.640282:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f5ae37-220d-45d9-b012-b91715df156e+3:2358:x1874546707769088:12345-192.168.204.46@tcp:251:umount.0 Request processed in 155us (3018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707394.640290:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 313 00010000:00010000:3.0:1787707394.640314:0:5844:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cfa05846800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787707394.640348:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa08747a00/0xc5f18d5f94ec0976 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0b9bd2 expref: 2 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707394.640362:0:5844:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cfa05846800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787707394.641341:0:5844:0:(genops.c:885:class_export_put()) final put ffff8cfa05846800/60f5ae37-220d-45d9-b012-b91715df156e 00010000:00010000:3.0:1787707394.641447:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707394.641451:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707394.641454:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787707394.641682:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa05846800/60f5ae37-220d-45d9-b012-b91715df156e for MGS 00000020:00000080:0.0:1787707394.641794:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfa05842000 for MGS 00010000:00010000:1.0:1787707395.321774:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707395.390163:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08771c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729771520:0@lo:400:kworker.0 00000100:00100000:3.0:1787707395.390230:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707395.390351:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08771180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729772032:0@lo:400:kworker.0 00000100:00100000:3.0:1787707395.390415:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707395.390447:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787707395.390454:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729771392:0@lo:400:kworker.0 00000100:00100000:3.0:1787707395.390481:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707395.390499:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729771904:0@lo:400:kworker.0 00000100:00100000:3.0:1787707395.390518:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707395.390540:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08772680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729771648:0@lo:400:kworker.0 00000100:00100000:3.0:1787707395.390563:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707395.390578:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787707395.390584:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729771776:0@lo:400:kworker.0 00000100:00100000:3.0:1787707395.390604:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707395.390768:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729771520 00000100:00100000:3.0:1787707395.390778:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729771520 00000100:00100000:3.0:1787707395.390817:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729771904 00000100:00100000:3.0:1787707395.390820:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729771904 00000100:00100000:3.0:1787707395.390861:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729771648 00000100:00100000:3.0:1787707395.390865:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729771648 00000100:00100000:3.0:1787707395.390881:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787707395.390889:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729771520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707395.391164:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729771520:12345-0@lo:400:kworker.0 Request processed in 274us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707395.391172:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787707395.391190:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787707395.391197:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729771904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707395.391226:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729771904:12345-0@lo:400:kworker.0 Request processed in 30us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707395.391232:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787707395.391243:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787707395.391249:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729771648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707395.391277:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729771648:12345-0@lo:400:kworker.0 Request processed in 28us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707395.391283:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787707395.391306:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729772032 00000100:00100000:3.0:1787707395.391310:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729772032 00000100:00100000:3.0:1787707395.391332:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729771776 00000100:00100000:3.0:1787707395.391334:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729771776 00000100:00100000:3.0:1787707395.391351:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787707395.391357:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729772032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707395.392754:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729772032:12345-0@lo:400:kworker.0 Request processed in 1388us (2340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707395.392767:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787707395.392799:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787707395.392828:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729771776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707395.392887:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729771776:12345-0@lo:400:kworker.0 Request processed in 65us (2282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707395.392893:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787707395.393176:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729771392 00000100:00100000:0.0:1787707395.393183:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729771392 00000100:00100000:0.0:1787707395.393225:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1787707395.393232:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa110eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729771392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707395.393269:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa110eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3315:x1874546729771392:12345-0@lo:400:kworker.0 Request processed in 38us (2787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707395.393275:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787707395.393737:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729771776:0@lo:400:kworker.0 00000100:00100000:3.0:1787707395.393753:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08772680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729771648:0@lo:400:kworker.0 00000100:00100000:3.0:1787707395.393791:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3315:1874546729771392:0@lo:400:kworker.0 00000100:00100000:3.0:1787707395.393804:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729771904:0@lo:400:kworker.0 00000100:00100000:3.0:1787707395.393815:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08771c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729771520:0@lo:400:kworker.0 00000100:00100000:3.0:1787707395.393826:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08771180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729772032:0@lo:400:kworker.0 00000100:00080000:1.0:1787707395.395283:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787707395.395291:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787707395.395295:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1787707395.445907:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9ed4058d-c366-401f-b84d-540fc0489f0c 00000020:00000080:0.0:1787707395.445917:0:7642:0:(genops.c:885:class_export_put()) final put ffff8cfa05843000/9ed4058d-c366-401f-b84d-540fc0489f0c 00000020:00000080:3.0:1787707395.446116:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa05843000/9ed4058d-c366-401f-b84d-540fc0489f0c for lustre-OST0001 00000020:00000080:3.0:1787707395.446243:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfa05840000 for lustre-OST0001 00000100:00100000:2.0:1787707395.899789:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729772160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787707395.899864:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707395.899940:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729772160 00000100:00100000:2.0:1787707395.899947:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729772160 00000100:00100000:2.0:1787707395.899991:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787707395.900001:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729772160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787707395.900033:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707395.900123:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729772160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707395.900130:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787707395.900194:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729772160:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1787707396.003246:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 07fb5f38-6916-4d1b-963f-1397d7cf8aaf 00000001:00080000:0.0:1787707396.003264:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1787707396.003268:0:5879:0:(genops.c:885:class_export_put()) final put ffff8cfa2f342000/07fb5f38-6916-4d1b-963f-1397d7cf8aaf 00000001:00100000:0.0:1787707396.003283:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9ed4058d-c366-401f-b84d-540fc0489f0c 00000001:00080000:0.0:1787707396.003298:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1787707396.003316:0:5879:0:(genops.c:885:class_export_put()) final put ffff8cf9012d1000/9ed4058d-c366-401f-b84d-540fc0489f0c 00000020:00000080:2.0:1787707396.003611:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa2f342000/07fb5f38-6916-4d1b-963f-1397d7cf8aaf for lustre-MDT0000 00000020:00000080:2.0:1787707396.003683:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf9012d1000/9ed4058d-c366-401f-b84d-540fc0489f0c for lustre-MDT0000 00000001:00100000:0.0:1787707396.003735:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9ed4058d-c366-401f-b84d-540fc0489f0c 00000020:00000080:0.0:1787707396.003740:0:6712:0:(genops.c:885:class_export_put()) final put ffff8cfa18484000/9ed4058d-c366-401f-b84d-540fc0489f0c 00000020:00000080:2.0:1787707396.005979:0:1375:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfa2f345000 for lustre-MDT0000 00000020:00000080:2.0:1787707396.005994:0:1375:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfa419d4000 for lustre-MDT0000 00000020:00000080:2.0:1787707396.006000:0:1375:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa18484000/9ed4058d-c366-401f-b84d-540fc0489f0c for lustre-OST0000 00000020:00000080:2.0:1787707396.006062:0:1375:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfa18483000 for lustre-OST0000 00000040:00080000:0.0:1787707396.024666:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787707396.024674:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787707396.025047:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787707396.025057:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787707396.346240:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787707396.802590:0:13027:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1787707396.815620:0:13027:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787707396.815673:0:13027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4e00/0xc5f18d5f94ec0945 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec094c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707396.815688:0:13027:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4e00/0xc5f18d5f94ec0945 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec094c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707396.815708:0:13027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4e00/0xc5f18d5f94ec0945 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec094c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707396.815717:0:13027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4e00/0xc5f18d5f94ec0945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec094c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707396.815739:0:13027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787707396.815744:0:13027:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787707396.815776:0:13027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787707396.815791:0:13027:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1787707396.815797:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:1.0:1787707396.815797:0:13027:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1787707396.815808:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4e00/0xc5f18d5f94ec0945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec094c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707396.815817:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4e00 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:3.0:1787707396.815822:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4e00/0xc5f18d5f94ec0945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec094c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787707396.815825:0:13027:0:(import.c:65:import_set_state_nolock()) ffff8cfa34aeb800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787707396.815835:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4e00/0xc5f18d5f94ec0945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f18d5f94ec094c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787707396.815844:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4e00/0xc5f18d5f94ec0945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f18d5f94ec094c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787707396.815862:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787707396.815865:0:5844:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787707396.815867:0:5844:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787707396.815895:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4e00/0xc5f18d5f94ec0945 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f18d5f94ec094c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707396.815901:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787707396.815927:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4e00/0xc5f18d5f94ec0945 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f18d5f94ec094c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707396.815934:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4e00/0xc5f18d5f94ec0945 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f18d5f94ec094c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707396.815946:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707396.815948:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707396.815950:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707396.815957:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787707396.815972:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa059b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729772416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787707396.816051:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707396.816111:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729772416 00000100:00100000:3.0:1787707396.816118:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729772416 00000100:00100000:3.0:1787707396.816166:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787707396.816174:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa113cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3316:x1874546729772416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787707396.816185:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707396.816200:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa08747e00/0xc5f18d5f94ec094c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f18d5f94ec0945 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707396.816212:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707396.816226:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874546729772288:0@lo:39:umount.0 00000100:00100000:3.0:1787707396.816259:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa113cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:3316:x1874546729772416:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707396.816270:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787707396.816274:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707396.816328:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729772288 00000100:00100000:3.0:1787707396.816332:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729772288 00000100:00100000:3.0:1787707396.816366:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787707396.816391:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874546729772288:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787707396.816411:0:5857:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec06cf 00000100:00080000:3.0:1787707396.816418:0:5857:0:(import.c:65:import_set_state_nolock()) ffff8cfa34aef800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787707396.816465:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3313:x1874546729772288:12345-0@lo:39:umount.0 Request processed in 76us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707396.816472:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1787707396.816477:0:5857:0:(genops.c:885:class_export_put()) final put ffff8cfa34aec800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1787707396.816495:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787707396.816504:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa34aec800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787707396.816668:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfa34aef800 for lustre-MDT0000 00000100:00080000:3.0:1787707396.816766:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cfa34aeb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787707396.816775:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874546729772288:0@lo:39:umount.0 00000100:00100000:1.0:1787707396.818658:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa059b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729772416:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787707396.818708:0:13027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787707396.818713:0:13027:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787707396.818717:0:13027:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787707396.828615:0:13027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa08746200/0xc5f18d5f94ec0953 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec095a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707396.828634:0:13027:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa08746200/0xc5f18d5f94ec0953 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec095a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707396.828641:0:13027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa08746200/0xc5f18d5f94ec0953 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec095a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707396.828649:0:13027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.146@tcp lock: ffff8cfa08746200/0xc5f18d5f94ec0953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec095a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707396.828672:0:13027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787707396.828679:0:13027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc400/0xc5f18d5f94ec087a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0881 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707396.828686:0:13027:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc400/0xc5f18d5f94ec087a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0881 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707396.828692:0:13027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc400/0xc5f18d5f94ec087a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec0881 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707396.828732:0:13027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc400/0xc5f18d5f94ec087a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec0881 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707396.828744:0:13027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787707396.828750:0:13027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4600/0xc5f18d5f94ec0b6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0b75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707396.828757:0:13027:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4600/0xc5f18d5f94ec0b6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0b75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707396.828763:0:13027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4600/0xc5f18d5f94ec0b6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec0b75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707396.828769:0:13027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4600/0xc5f18d5f94ec0b6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec0b75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707396.828777:0:13027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787707396.828782:0:13027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa00030a00/0xc5f18d5f94ec062e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0635 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707396.828787:0:13027:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa00030a00/0xc5f18d5f94ec062e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0635 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707396.828793:0:13027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa00030a00/0xc5f18d5f94ec062e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec0635 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707396.828799:0:13027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.146@tcp lock: ffff8cfa00030a00/0xc5f18d5f94ec062e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec0635 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707396.828815:0:13027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1787707396.828819:0:13027:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787707396.828843:0:13027:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787707396.828847:0:13027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787707396.828850:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787707396.828855:0:13027:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1787707396.828861:0:13027:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8cfa419d2800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787707396.828867:0:13027:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8cfa3fa31800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787707396.828872:0:13027:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8cfa3add8000) has exports, disconnecting them 00000020:00080000:1.0:1787707396.828876:0:13027:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cfa419d2800), last request at 1787707395 00000020:00000080:1.0:1787707396.828883:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec0842 00000100:00080000:1.0:1787707396.828898:0:13027:0:(import.c:65:import_set_state_nolock()) ffff8cfa419d1800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787707396.828938:0:13027:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfa419d2800): rc 0 00000020:00000080:1.0:1787707396.828940:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cfa419d2800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787707396.828950:0:13027:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cfa3fa31800), last request at 1787707395 00000020:00000080:1.0:1787707396.828954:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec0777 00000100:00080000:1.0:1787707396.828959:0:13027:0:(import.c:65:import_set_state_nolock()) ffff8cfa3fa32800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787707396.828965:0:13027:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfa3fa31800): rc 0 00000020:00000080:1.0:1787707396.828967:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cfa3fa31800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1787707396.828972:0:13027:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9ec680c8fae0 00000100:00080000:1.0:1787707396.828992:0:13027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787707396.828995:0:13027:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00010000:00010000:0.0:1787707396.829668:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787707396.829678:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa08746200/0xc5f18d5f94ec0953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec095a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.829688:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa08746200 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:0.0:1787707396.829692:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa08746200/0xc5f18d5f94ec0953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec095a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.829701:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa08746200/0xc5f18d5f94ec0953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f18d5f94ec095a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787707396.829708:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa08746200/0xc5f18d5f94ec0953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f18d5f94ec095a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707396.829713:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787707396.829716:0:7630:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1787707396.829718:0:7630:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1787707396.829753:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa08746200/0xc5f18d5f94ec0953 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f18d5f94ec095a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.829760:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787707396.829791:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa08746200/0xc5f18d5f94ec0953 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f18d5f94ec095a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.829797:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa08746200/0xc5f18d5f94ec0953 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f18d5f94ec095a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.829808:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787707396.829811:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc400/0xc5f18d5f94ec087a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec0881 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.829816:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc400 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:0.0:1787707396.829819:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc400/0xc5f18d5f94ec087a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec0881 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.829824:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc400/0xc5f18d5f94ec087a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f18d5f94ec0881 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787707396.829830:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc400/0xc5f18d5f94ec087a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f18d5f94ec0881 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707396.829834:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787707396.829836:0:7630:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787707396.829838:0:7630:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787707396.829850:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc400/0xc5f18d5f94ec087a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f18d5f94ec0881 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.829857:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787707396.829862:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc400/0xc5f18d5f94ec087a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f18d5f94ec0881 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.829868:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc400/0xc5f18d5f94ec087a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f18d5f94ec0881 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.829890:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787707396.829894:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4600/0xc5f18d5f94ec0b6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec0b75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.829900:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4600 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:0.0:1787707396.829903:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4600/0xc5f18d5f94ec0b6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec0b75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.829910:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4600/0xc5f18d5f94ec0b6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f18d5f94ec0b75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787707396.829916:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4600/0xc5f18d5f94ec0b6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f18d5f94ec0b75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707396.829921:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787707396.829923:0:7630:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787707396.829925:0:7630:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787707396.829939:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4600/0xc5f18d5f94ec0b6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f18d5f94ec0b75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.829945:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787707396.829961:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4600/0xc5f18d5f94ec0b6e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f18d5f94ec0b75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.829968:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4600/0xc5f18d5f94ec0b6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f18d5f94ec0b75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.829977:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787707396.829980:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa00030a00/0xc5f18d5f94ec062e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec0635 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.829991:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa00030a00 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:0.0:1787707396.829994:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa00030a00/0xc5f18d5f94ec062e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec0635 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.830000:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa00030a00/0xc5f18d5f94ec062e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f18d5f94ec0635 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787707396.830006:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa00030a00/0xc5f18d5f94ec062e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f18d5f94ec0635 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1787707396.830238:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa419d2800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787707396.830272:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa3fa31800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787707396.830295:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfa419d1800 for lustre-MDT0000 00000020:00000080:3.0:1787707396.830300:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfa3fa32800 for lustre-MDT0000 00010000:00010000:3.0:1787707396.830308:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707396.830317:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787707396.831271:0:13027:0:(osp_dev.c:1634:osp_import_event()) got inactive 10000000:01000000:0.0:1787707396.831523:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787707396.831525:0:7630:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787707396.831528:0:7630:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787707396.831555:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa00030a00/0xc5f18d5f94ec062e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f18d5f94ec0635 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.831563:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787707396.831573:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa00030a00/0xc5f18d5f94ec062e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f18d5f94ec0635 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.831579:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa00030a00/0xc5f18d5f94ec062e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f18d5f94ec0635 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.831594:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707396.831595:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707396.831598:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707396.831614:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729772544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787707396.831677:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707396.831738:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787707396.831755:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729772672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787707396.831774:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707396.831798:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729772800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787707396.831815:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707396.831829:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787707396.831833:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729772928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787707396.831846:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707396.831870:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729772544 00000100:00100000:0.0:1787707396.831876:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729772544 00000100:00100000:0.0:1787707396.831911:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729772672 00000100:00100000:0.0:1787707396.831913:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729772672 00000100:00100000:0.0:1787707396.831922:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729772800 00000100:00100000:0.0:1787707396.831924:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729772800 00000100:00100000:0.0:1787707396.831934:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729772928 00000100:00100000:0.0:1787707396.831937:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729772928 00000100:00100000:0.0:1787707396.831950:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787707396.831957:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+21:3314:x1874546729772544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787707396.831969:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707396.831982:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa3fcd3c00/0xc5f18d5f94ec095a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f18d5f94ec0953 expref: 21 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.831993:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1787707396.832114:0:13027:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787707396.832131:0:13027:0:(import.c:65:import_set_state_nolock()) ffff8cfa35b30800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787707396.832148:0:13027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787707396.832152:0:13027:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1787707396.832167:0:13027:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787707396.832227:0:13027:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787707396.832234:0:13027:0:(import.c:65:import_set_state_nolock()) ffff8cf9012d6000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787707396.832265:0:13027:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8cfa3add8000) has no exports 00000100:00100000:3.0:1787707396.832858:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729773056:0@lo:9:umount.0 00000100:00100000:3.0:1787707396.832897:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707396.832929:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729773184:0@lo:9:umount.0 00000100:00100000:3.0:1787707396.832960:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707396.832989:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729773056 00000100:00100000:3.0:1787707396.832993:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729773056 00000100:00100000:2.0:1787707396.833712:0:12022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729773184 00000100:00100000:2.0:1787707396.833717:0:12022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729773184 00000100:00100000:2.0:1787707396.833756:0:12022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787707396.833773:0:12022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1874546729773184:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787707396.833797:0:12022:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec08ab 00000100:00080000:2.0:1787707396.833806:0:12022:0:(import.c:65:import_set_state_nolock()) ffff8cfa419d6000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787707396.833837:0:12022:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787707396.834202:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787707396.834210:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874546729773056:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787707396.834225:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec07c4 00000100:00080000:3.0:1787707396.834232:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8cf901154800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787707396.834255:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787707396.834568:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+20:3314:x1874546729772544:12345-0@lo:103:ldlm_bl.0 Request processed in 2609us (2889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707396.834578:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787707396.834600:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787707396.834609:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+19:3314:x1874546729772672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787707396.834622:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707396.834649:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa029d5800/0xc5f18d5f94ec0881 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f18d5f94ec087a expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.834665:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707396.835104:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+18:3314:x1874546729772672:12345-0@lo:103:ldlm_bl.0 Request processed in 496us (3327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707396.835111:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787707396.835126:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787707396.835134:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+17:3316:x1874546729772800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787707396.835143:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707396.835155:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec0b75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f18d5f94ec0b6e expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707396.835164:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707396.835590:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3313:x1874546729773056:12345-0@lo:9:umount.0 Request processed in 1380us (2690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707396.835597:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:3.0:1787707396.835622:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707396.835629:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787707396.835659:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cfa35b30800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787707396.835673:0:3313:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787707396.835675:0:3313:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787707396.835679:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729773056:0@lo:9:umount.0 00000100:00100000:3.0:1787707396.835815:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787707396.835823:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+16:3316:x1874546729772928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787707396.835834:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707396.835845:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa029d4800/0xc5f18d5f94ec0635 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f18d5f94ec062e expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707396.835858:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707396.836215:0:12022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3313:x1874546729773184:12345-0@lo:9:umount.0 Request processed in 2442us (3252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707396.836224:0:12022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1787707396.836251:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cf9012d6000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787707396.836260:0:3313:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787707396.836262:0:3313:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787707396.836264:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729773184:0@lo:9:umount.0 00000100:00100000:1.0:1787707396.836325:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729772800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787707396.836779:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+15:3316:x1874546729772928:12345-0@lo:103:ldlm_bl.0 Request processed in 956us (4930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707396.836788:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787707396.836910:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3316:1874546729772928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787707396.837088:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d+14:3316:x1874546729772800:12345-0@lo:103:ldlm_bl.0 Request processed in 1953us (5269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707396.837096:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787707396.837125:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729772672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787707396.837135:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729772544:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1787707396.846111:0:13027:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8cfa3add8000) has no exports 00000020:00000080:1.0:1787707396.918224:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec0689 00000020:00000080:1.0:1787707396.918242:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cfa3a863800/lustre-QMT0000_UUID 00000020:01000000:1.0:1787707396.918269:0:13027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787707396.918342:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa3a863800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787707396.918591:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787707396.918602:0:13027:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787707396.918607:0:13027:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8cfa359f0000) has no exports 00000020:00000080:0.0:1787707396.920107:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec0682 00000020:00000080:0.0:1787707396.920117:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cfa359ee800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787707396.920187:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787707396.920196:0:13027:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787707396.920199:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cfa359ec800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787707396.920202:0:13027:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa359ec800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787707396.920224:0:13027:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1787707396.920712:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa359ee800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787707396.921275:0:13027:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfa3cbdab40 - data ffff8cfa307f91b0/ffff8cf901f2c000 00000020:01000000:0.0:1787707396.921497:0:13027:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfa02e95180 - data ffff8cfa1ef4ce58/ffff8cfa4191cc00 00000001:00000004:0.0:1787707396.938786:0:13027:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1787707396.999149:0:13027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787707396.999159:0:13027:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1787707396.999180:0:13027:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787707396.999183:0:13027:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787707396.999578:0:6917:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787707396.999582:0:6917:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1787707396.999592:0:6917:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787707397.001025:0:13027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787707397.001031:0:13027:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787707397.001052:0:13027:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787707397.001055:0:13027:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787707397.001420:0:7932:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787707397.001425:0:7932:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1787707397.001433:0:7932:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787707397.168282:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec0651 00000020:00000080:3.0:1787707397.168296:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cfa34ad2800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787707397.168408:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa34ad2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787707397.178743:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec0666 00000020:00000080:2.0:1787707397.178758:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cfa3acd9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787707397.178781:0:13027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787707397.178788:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787707397.178796:0:13027:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787707397.178800:0:13027:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8cfa3addcd28) has no exports 00000020:00000080:1.0:1787707397.178843:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa3acd9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1787707397.183144:0:13027:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787707397.183163:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec08a4 00000020:00000080:3.0:1787707397.183174:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cf9012d0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787707397.183187:0:13027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787707397.183194:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787707397.183204:0:13027:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787707397.183209:0:13027:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8cfa058ab370) has no exports 00000020:00000080:3.0:1787707397.183217:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec089d 00000020:00000080:3.0:1787707397.183221:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cf9012d2800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1787707397.183587:0:13027:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787707397.183592:0:13027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787707397.183596:0:13027:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1787707397.183601:0:13027:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787707397.183603:0:13027:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787707397.183635:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787707397.183642:0:13027:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787707397.183647:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec07bd 00000020:00000080:3.0:1787707397.183652:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cfa3f9b7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787707397.183656:0:13027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787707397.183659:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787707397.183662:0:13027:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787707397.183664:0:13027:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8cfa110e19b8) has no exports 00000020:00000080:3.0:1787707397.183668:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec07b6 00000020:00000080:3.0:1787707397.183670:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cfa35b31000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787707397.183962:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf9012d0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787707397.183974:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf9012d2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787707397.183981:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cf9012d6000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787707397.183995:0:8:0:(genops.c:885:class_export_put()) final put ffff8cf9012d6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787707397.183998:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf9012d6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787707397.184002:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00010000:01000000:2.0:1787707397.184050:0:13027:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787707397.184055:0:13027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787707397.184058:0:13027:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1787707397.184062:0:13027:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787707397.184064:0:13027:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787707397.184094:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa3f9b7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787707397.184102:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa35b31000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787707397.184107:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfa35b30800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787707397.184119:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787707397.184126:0:13027:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787707397.184130:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cfa06e17000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787707397.184132:0:13027:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa06e17000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787707397.184138:0:13027:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787707397.184249:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787707397.184254:0:13027:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787707397.184257:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cfa34ad6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787707397.184262:0:13027:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa34ad6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787707397.184267:0:13027:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787707397.184400:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec066d 00000020:00000080:2.0:1787707397.184406:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cfa3acda000/lustre-MDD0000_UUID 00000020:01000000:2.0:1787707397.184414:0:13027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787707397.184417:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787707397.184421:0:13027:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787707397.184424:0:13027:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8cfa3addb370) has no exports 00000020:00000080:3.0:1787707397.184438:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa3acda000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787707397.184775:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787707397.184781:0:13027:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787707397.184785:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cfa34ad4800/lustre-MDD0000_UUID 00000020:00000080:2.0:1787707397.184787:0:13027:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa34ad4800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787707397.184794:0:13027:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1787707397.185403:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec0674 00000020:00000080:2.0:1787707397.185410:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cfa3acde800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787707397.185497:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa3acde800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1787707397.185883:0:13027:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfa02b55800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787707397.185889:0:13027:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfa02b55800 3 00000020:01000004:2.0:1787707397.186147:0:13027:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cfa02b55800 from lustre-MDT0000 00000020:00000080:2.0:1787707397.186180:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787707397.186188:0:13027:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787707397.186192:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cfa34ad7800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787707397.186195:0:13027:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa34ad7800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787707397.186208:0:13027:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787707397.186256:0:13027:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787707397.186260:0:13027:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787707397.186264:0:13027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787707397.186268:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787707397.186271:0:13027:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787707397.186278:0:13027:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8cfa29aef800 5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787707397.186284:0:13027:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8cfa0584cd28) has exports, disconnecting them 00000020:00080000:2.0:1787707397.186290:0:13027:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8cfa29aef800), last request at 1787707138 00000020:00000080:2.0:1787707397.186305:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec0612 00000020:00010000:2.0:1787707397.186310:0:13027:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cfa29aef800: total 0 00000100:00080000:2.0:1787707397.186315:0:13027:0:(import.c:65:import_set_state_nolock()) ffff8cfa29ae8000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787707397.186327:0:13027:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfa29aef800): rc 0 00000020:00080000:2.0:1787707397.186332:0:13027:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8cfa0584cd28) has no exports 00000020:00010000:1.0:1787707397.186355:0:7630:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cfa29aef800: total 0 00010000:00010000:1.0:1787707397.186453:0:7630:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cfa29aef800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787707397.186484:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa421fd000/0xc5f18d5f94ec072a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f18d5f94ec0723 expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707397.186513:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa029d4200/0xc5f18d5f94ec0968 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f18d5f94ec0961 expref: 8 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707397.186526:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa0871b800/0xc5f18d5f94ec0b67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f18d5f94ec0b60 expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707397.186536:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa3fcd3800/0xc5f18d5f94ec0914 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f18d5f94ec090d expref: 6 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707397.186547:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa3fcd2c00/0xc5f18d5f94ec0930 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f18d5f94ec0929 expref: 5 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707397.186556:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa00030c00/0xc5f18d5f94ec0922 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f18d5f94ec091b expref: 4 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707397.186566:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec0b59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f18d5f94ec0b52 expref: 3 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707397.186578:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa00030e00/0xc5f18d5f94ec093e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f18d5f94ec0937 expref: 2 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707397.186589:0:7630:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cfa29aef800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1787707397.186602:0:7630:0:(genops.c:885:class_export_put()) final put ffff8cfa29aef800/5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d 00010000:00010000:1.0:1787707397.186611:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707397.186613:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707397.186615:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707397.186690:0:5848:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8cfa06e8d800:5848] 0 exiting: rc = 1 00000020:00000080:2.0:1787707397.186773:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa29aef800/5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d for MGS 00000020:00000080:2.0:1787707397.186820:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfa29ae8000 for MGS 00000100:00100000:0.0:1787707397.186833:0:5850:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8cfa08615400:5850] 1 exiting: rc = 0 00000100:00100000:0.0:1787707397.186882:0:5851:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8cfa06e7f800:5851] 2 exiting: rc = 0 00000100:00100000:2.0:1787707397.188176:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188190:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188196:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188202:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188208:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188215:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188223:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188230:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188235:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188241:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188247:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188254:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188260:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188267:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188272:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188278:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188284:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188290:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188308:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188313:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188319:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188325:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188331:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188337:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188343:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188784:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188798:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188810:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188818:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188823:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188836:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188843:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188849:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188854:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.188860:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189483:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189497:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189505:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189513:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189519:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189527:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189535:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189543:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189551:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189559:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189568:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189575:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189583:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189592:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189600:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189609:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189617:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189625:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189644:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189651:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189657:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189665:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189674:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189699:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189706:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189717:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189724:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189730:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707397.189735:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1787707397.191881:0:13027:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787707397.191905:0:13027:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1787707397.195674:0:13027:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfa2ac3d8a0 - data ffff8cfa3fe04d80/ffff8cfa4199e400 00000020:01000000:1.0:1787707397.195799:0:13027:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfa111ee960 - data ffff8cfa1ef40948/ffff8cfa073b5800 00000020:00000080:1.0:1787707397.196266:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec05f6 00000020:00000080:1.0:1787707397.196283:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cfa0b9f8000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787707397.196307:0:13027:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfa02b55800 from MGS, refs=2 00000020:01000004:1.0:1787707397.196310:0:13027:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfa02b55800 2 00000020:01000004:1.0:1787707397.196313:0:13027:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cfa02b55800 from MGS 00000020:00000080:1.0:1787707397.196334:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787707397.196340:0:13027:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787707397.196343:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cfa12b0b000/MGS 00000020:00000080:1.0:1787707397.196345:0:13027:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa12b0b000/MGS for MGS 00000020:01000000:1.0:1787707397.196356:0:13027:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787707397.196438:0:13027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787707397.196443:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787707397.196448:0:13027:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787707397.196455:0:13027:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8cfa3a867800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787707397.196460:0:13027:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8cfa359f3370) has exports, disconnecting them 00000020:00080000:1.0:1787707397.196465:0:13027:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8cfa3a867800), last request at 1787707139 00000020:00000080:1.0:1787707397.196469:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec06c1 00000020:00080000:1.0:1787707397.196478:0:13027:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfa3a867800): rc 0 00000020:00000080:1.0:1787707397.196482:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cfa3a867800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787707397.197094:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa0b9f8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787707397.197109:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa3a867800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787707397.202498:0:13027:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787707397.202509:0:13027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787707397.202514:0:13027:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787707397.202524:0:13027:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787707397.202782:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787707397.202791:0:13027:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787707397.202796:0:13027:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfa02b55800 1 00000020:00000080:0.0:1787707397.202802:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec05e8 00000020:00000080:0.0:1787707397.202810:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cfa12b09800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787707397.202834:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfa34aeb800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787707397.202841:0:8:0:(genops.c:885:class_export_put()) final put ffff8cfa34aed800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787707397.202844:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa34aed800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787707397.202854:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1787707397.202960:0:13027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787707397.202965:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787707397.202970:0:13027:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787707397.202974:0:13027:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8cfa110e4d28) has no exports 00000020:00000080:2.0:1787707397.203164:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa12b09800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787707397.261187:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787707397.261203:0:13027:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1787707397.261209:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cfa12b09000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787707397.261214:0:13027:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa12b09000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787707397.261221:0:13027:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1787707397.261453:0:13027:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cfa102ae800 00000020:01000000:3.0:1787707397.261475:0:13027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787707397.261479:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787707397.261484:0:13027:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787707397.261488:0:13027:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8cfa0584b370) has no exports 00000100:00100000:3.0:1787707397.261684:0:5857:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8cfa1f8af600:5857] 1 exiting: rc = 0 00000100:00100000:2.0:1787707397.261831:0:5858:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8cfa110c0800:5858] 2 exiting: rc = 0 00000100:00100000:2.0:1787707397.261910:0:5856:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8cfa11011800:5856] 0 exiting: rc = 1 00000100:00100000:0.0:1787707397.263143:0:8469:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8cfa087c6200:8469] 3 exiting: rc = 0 00000100:00100000:0.0:1787707397.263574:0:12425:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8cfa41a39400:12425] 4 exiting: rc = 0 00000100:00100000:3.0:1787707397.265198:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265207:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265214:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265219:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265225:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265230:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265236:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265241:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265247:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265251:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265256:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265262:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265268:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265274:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265280:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265285:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265290:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265295:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265301:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265324:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265330:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265335:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265341:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265346:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265351:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265357:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265363:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265388:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265396:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265403:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265408:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265413:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265419:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265425:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265430:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265436:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265441:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265447:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265452:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265457:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265462:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265467:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265473:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265478:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265483:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265503:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265510:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265515:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265520:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265525:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265530:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265535:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265541:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265546:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265558:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265563:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265568:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265573:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265578:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265583:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265588:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265594:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265600:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.265605:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.269170:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8cfa18a63000:5860] 1 exiting: rc = 0 00000100:00100000:1.0:1787707397.269171:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8cfa18a63a00:5859] 0 exiting: rc = 1 00000100:00100000:3.0:1787707397.269283:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269291:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269297:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269302:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269307:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269313:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269318:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269324:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269330:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269336:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269342:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269348:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269354:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269359:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269364:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269433:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269440:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269445:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269450:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269456:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269461:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269466:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269472:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269477:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269482:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269502:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269508:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269513:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269518:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269523:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269529:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269534:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269539:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269545:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269550:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269556:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269561:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269566:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269571:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269576:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269582:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269587:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269591:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269597:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269602:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269607:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269612:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269617:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269684:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269692:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269696:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269702:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269707:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269711:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269716:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269721:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269725:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269729:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269734:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269738:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269749:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269754:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269759:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.269763:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.270290:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8cfa110c0000:5862] 1 exiting: rc = 0 00000100:00100000:1.0:1787707397.270364:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8cfa18a63600:5861] 0 exiting: rc = 1 00000100:00100000:3.0:1787707397.270550:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270559:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270565:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270571:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270577:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270583:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270589:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270595:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270601:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270607:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270613:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270628:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270635:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270641:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270647:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270653:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270658:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270664:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270670:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270677:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270682:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270693:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270699:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270716:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270724:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270730:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270736:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270742:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270748:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270753:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270759:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270774:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270780:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270786:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270791:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270811:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270820:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.270826:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274557:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274575:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274581:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274586:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274593:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274605:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274611:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274617:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274622:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274657:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274664:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274726:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274734:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274740:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274746:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274814:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274822:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274828:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274834:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274839:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274845:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274866:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274873:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274879:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274887:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.274894:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787707397.282744:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8cfa110c1e00:5863] 0 exiting: rc = 1 00000100:00100000:2.0:1787707397.283193:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8cfa110c0e00:5864] 1 exiting: rc = 0 00000100:00100000:0.0:1787707397.283449:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.283460:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.283466:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.283475:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.283482:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.283488:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.283494:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284030:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284055:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284059:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284064:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284069:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284074:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284080:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284085:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284090:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284095:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284101:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284106:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284111:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284116:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284121:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284127:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284132:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284137:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284142:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284147:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284153:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284158:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284163:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284168:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284173:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284179:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284184:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284190:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284196:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284202:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284207:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284213:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284218:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284223:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284229:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284234:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284246:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284252:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284257:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284262:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284268:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284273:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284278:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284283:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284288:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284292:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284297:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284302:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284307:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284312:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284317:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284323:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284328:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284332:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284338:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284343:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.284348:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787707397.286021:0:5866:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8cfa110c0600:5866] 1 exiting: rc = 0 00000100:00100000:2.0:1787707397.286060:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8cfa110c1800:5865] 0 exiting: rc = 1 00000100:00100000:0.0:1787707397.286124:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286150:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286156:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286161:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286166:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286171:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286176:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286182:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286191:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286198:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286203:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286209:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286214:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286219:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286238:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286242:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286247:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286252:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286257:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286261:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286267:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286272:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286277:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286282:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286287:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286291:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286296:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286301:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286307:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286311:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286316:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286320:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286326:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286330:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286335:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286339:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286344:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286348:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286353:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286358:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286362:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286366:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286447:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286453:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286458:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286463:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286468:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286473:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286478:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286491:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286496:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286512:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286518:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286523:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286527:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286532:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286537:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286541:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286546:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286551:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286734:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286740:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286745:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.286750:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.288455:0:5868:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8cfa110c1000:5868] 1 exiting: rc = 0 00000100:00100000:1.0:1787707397.288624:0:5867:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8cfa110c1600:5867] 0 exiting: rc = 1 00000100:00100000:0.0:1787707397.288800:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288807:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288813:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288817:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288822:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288827:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288832:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288837:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288842:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288847:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288853:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288858:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288863:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288869:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288874:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288880:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288885:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288890:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288896:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288901:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288919:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288925:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288929:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288934:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288940:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288944:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288949:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288954:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288959:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288964:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288969:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288973:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288978:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288983:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288988:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288993:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.288998:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289004:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289025:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289033:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289039:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289044:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289048:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289053:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289059:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289064:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289070:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289074:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289080:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289084:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289089:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289094:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289099:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289104:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289110:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289123:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289128:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289132:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289137:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289142:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289148:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289152:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289157:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.289162:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707397.290550:0:5871:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8cfa08611a00:5871] 2 exiting: rc = 0 00000100:00100000:1.0:1787707397.290970:0:5870:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8cfa05c52a00:5870] 1 exiting: rc = 0 00000100:00100000:2.0:1787707397.291233:0:5869:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8cfa05c52000:5869] 0 exiting: rc = 1 00000100:00100000:0.0:1787707397.293079:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293097:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293103:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293109:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293114:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293120:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293125:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293130:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293135:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293140:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293145:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293170:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293178:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293184:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293189:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293195:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293199:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293205:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293211:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293217:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293222:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293228:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293234:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293239:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293244:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293250:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293270:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293276:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293281:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293287:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293292:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293298:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293303:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293309:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293315:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293336:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293343:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293349:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293354:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293360:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293366:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293463:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293470:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293476:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293482:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293487:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293492:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293497:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293502:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293507:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293513:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293517:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293522:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293527:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293532:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293538:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293542:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293547:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293714:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293723:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293729:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293742:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293747:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707397.293752:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787707397.300706:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787707397.300720:0:13027:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787707397.300726:0:13027:0:(genops.c:885:class_export_put()) final put ffff8cfa08a7a000/MDS_uuid 00000020:00000080:0.0:1787707397.300730:0:13027:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa08a7a000/MDS_uuid for MDS 00000020:01000000:0.0:1787707397.300740:0:13027:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787707397.300906:0:13027:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787707397.369490:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707398.401542:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707399.423447:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707400.440590:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787707400.443878:0:13178:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787707400.471192:0:13178:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787707400.471239:0:13178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2400/0xc5f18d5f94ec0929 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0930 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707400.471256:0:13178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2400/0xc5f18d5f94ec0929 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0930 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707400.471264:0:13178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2400/0xc5f18d5f94ec0929 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec0930 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707400.471272:0:13178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2400/0xc5f18d5f94ec0929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec0930 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707400.471980:0:13178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787707400.471989:0:13178:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787707400.472013:0:13178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787707400.472018:0:13178:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787707400.472024:0:13178:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787707400.472050:0:13178:0:(import.c:65:import_set_state_nolock()) ffff8cf901153000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787707400.472424:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874546729773312:0@lo:39:umount.0 00000400:00000100:2.0:1787707400.472479:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874546729773312 offset 0 length 224: 4 00010000:00010000:0.0:1787707400.472704:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787707400.472714:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2400/0xc5f18d5f94ec0929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec0930 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707400.472724:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2400 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:0.0:1787707400.472728:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2400/0xc5f18d5f94ec0929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec0930 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707400.472801:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2400/0xc5f18d5f94ec0929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f18d5f94ec0930 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787707400.472810:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2400/0xc5f18d5f94ec0929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f18d5f94ec0930 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707400.472816:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787707400.472819:0:5844:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787707400.472821:0:5844:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787707400.473002:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2400/0xc5f18d5f94ec0929 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f18d5f94ec0930 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707400.473009:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787707400.473048:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08772300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729773440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787707400.473086:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707400.473150:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729773440 00000100:00100000:2.0:1787707400.473156:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729773440 00000100:00100000:2.0:1787707400.473204:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787707400.473211:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3314:x1874546729773440:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787707400.473218:0:5842:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787707400 with bad export cookie 14263336936518977042 00010000:00010000:3.0:1787707400.475791:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2400/0xc5f18d5f94ec0929 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f18d5f94ec0930 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707400.475808:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2400/0xc5f18d5f94ec0929 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f18d5f94ec0930 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707400.475854:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707400.475856:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707400.475858:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707400.481965:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3314:x1874546729773440:12345-0@lo:103:ldlm_bl.0 Request processed in 8736us (8861us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787707400.481981:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787707400.482110:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.146@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787707400.482115:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8cfa08a7d000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787707400.482119:0:3314:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.146@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1787707400.497230:0:3314:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.146@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787707400.497237:0:3314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787707400.497266:0:3314:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfa08772300 x1874546729773440/t0(0) o103->MGC192.168.204.146@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787707416 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787707400.497284:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787707400.497287:0:3314:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787707400.497289:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787707400.497294:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8cfa08a7d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787707400.497299:0:3314:0:(import.c:510:import_select_connection()) MGC192.168.204.146@tcp: connect to NID 0@lo last attempt 189 00000100:00080000:1.0:1787707400.497309:0:3314:0:(import.c:624:import_select_connection()) MGC192.168.204.146@tcp: import ffff8cfa08a7d000 using connection 192.168.204.146@tcp/0@lo 00000100:00100000:3.0:1787707400.497437:0:3314:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfa08773100 x1874546729773568/t0(0) o250->MGC192.168.204.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787707400.497477:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08772300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3314:1874546729773440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787707400.497479:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3313:1874546729773568:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1787707400.497531:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874546729773568 offset 0 length 520: 4 00000100:00100000:1.0:1787707400.506017:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787707400.506142:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f152300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729773696:0@lo:400:kworker.0 00000400:00000100:3.0:1787707400.506197:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874546729773696 offset 0 length 224: 4 00000001:00100000:0.0:1787707400.568177:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787707400.568191:0:7642:0:(genops.c:885:class_export_put()) final put ffff8cfa419d3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787707400.568312:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa419d3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787707400.568407:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfa419d6000 for lustre-OST0001 00000001:00100000:1.0:1787707401.110137:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787707401.110147:0:6712:0:(genops.c:885:class_export_put()) final put ffff8cf901156000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787707401.112580:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf901156000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787707401.113051:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cf901154800 for lustre-OST0000 00010000:00010000:1.0:1787707401.465825:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707402.489145:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707403.512673:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707404.536611:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707405.561513:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787707405.625061:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787707405.625071:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787707405.625142:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874546729773824:0@lo:400:kworker.0 00000400:00000100:1.0:1787707405.625198:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874546729773824 offset 0 length 224: 4 00010000:00010000:3.0:1787707406.584730:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707407.608835:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707408.632849:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707409.657437:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707410.681086:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707410.748153:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787707400/real 1787707400] req@ffff8cfa08773100 x1874546729773568/t0(0) o250->MGC192.168.204.146@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787707410 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707410.748187:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfa08773100 x1874546729773568/t0(0) o250->MGC192.168.204.146@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787707410 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707410.748198:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787707400/real 1787707400] req@ffff8cfa08773800 x1874546729773312/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787707410 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707410.748210:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfa08773800 x1874546729773312/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787707410 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787707410.748229:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cfa08a7d000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787707410.748253:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787707410.748257:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3313:1874546729773568:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1787707410.748263:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cf901153000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787707410.748277:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874546729773312:0@lo:39:umount.0 00000100:00080000:3.0:1787707410.748445:0:13178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787707410.748450:0:13178:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787707410.748454:0:13178:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787707410.749621:0:13178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec0937 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec093e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707410.749638:0:13178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec0937 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec093e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707410.749646:0:13178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec0937 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec093e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707410.749653:0:13178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec0937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec093e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707410.749703:0:13178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787707410.749710:0:13178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0b67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707410.749718:0:13178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0b67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707410.749724:0:13178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec0b67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707410.749731:0:13178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec0b67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707410.749746:0:13178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787707410.749750:0:13178:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787707410.749779:0:13178:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787707410.749783:0:13178:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787707410.749788:0:13178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787707410.749794:0:13178:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787707410.749798:0:13178:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8cfa110e3370) has no exports 00000020:00080000:3.0:1787707410.749825:0:13178:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8cfa110e3370) has no exports 00000100:00080000:1.0:1787707410.750104:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787707410.750111:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787707410.750114:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cfa08a7d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787707410.750132:0:8:0:(import.c:510:import_select_connection()) MGC192.168.204.146@tcp: connect to NID 0@lo last attempt 451 00000100:00080000:1.0:1787707410.750144:0:8:0:(import.c:589:import_select_connection()) MGC192.168.204.146@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787707410.750150:0:8:0:(import.c:624:import_select_connection()) MGC192.168.204.146@tcp: import ffff8cfa08a7d000 using connection 192.168.204.146@tcp/0@lo 00000100:00100000:1.0:1787707410.750180:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfa2f153100 x1874546729773952/t0(0) o250->MGC192.168.204.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787707410.750244:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874546729774080:0@lo:400:kworker.0 00000400:00000100:1.0:1787707410.750309:0:3317:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874546729774080 offset 0 length 224: 4 00010000:00010000:1.0:1787707410.750413:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787707410.750420:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec0937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec093e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707410.750428:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2e00 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:1.0:1787707410.750432:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec0937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec093e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707410.750441:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec0937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f18d5f94ec093e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787707410.750448:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec0937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f18d5f94ec093e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707410.750453:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787707410.750456:0:5844:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787707410.750458:0:5844:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787707410.750470:0:5844:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfa08a7d000 00010000:00010000:1.0:1787707410.750473:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec0937 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f18d5f94ec093e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707410.750479:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec0937 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f18d5f94ec093e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707410.750503:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787707410.750507:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec0b67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707410.750512:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fdc00 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:1.0:1787707410.750515:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec0b67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707410.750522:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f18d5f94ec0b67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787707410.750527:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f18d5f94ec0b67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707410.750532:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787707410.750534:0:5844:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787707410.750536:0:5844:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787707410.750543:0:5844:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfa08a7d000 00010000:00010000:1.0:1787707410.750546:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b60 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f18d5f94ec0b67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707410.750552:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec0b60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f18d5f94ec0b67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707410.750561:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707410.750563:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707410.750564:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707410.752266:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707410.752296:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3313:1874546729773952:0@lo:250:kworker.0 00000400:00000100:2.0:1787707410.752351:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874546729773952 offset 0 length 520: 4 00000020:01000000:3.0:1787707410.760256:0:13178:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfa05d1c060 - data ffff8cfa3043ce58/ffff8cfa419c6400 00000020:01000000:3.0:1787707410.760472:0:13178:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfa05c271e0 - data ffff8cfa3040b870/ffff8cfa3f998c00 00100000:10000000:3.0:1787707410.784418:0:13178:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787707410.820397:0:13178:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec0746 00000020:00000080:1.0:1787707410.820409:0:13178:0:(genops.c:885:class_export_put()) final put ffff8cfa3fa31000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787707410.820437:0:13178:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfa34ab9800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787707410.820440:0:13178:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfa34ab9800 2 00000020:01000004:1.0:1787707410.820443:0:13178:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cfa34ab9800 from lustre-OST0000 00000020:00000080:1.0:1787707410.820470:0:13178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787707410.820479:0:13178:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787707410.820481:0:13178:0:(genops.c:885:class_export_put()) final put ffff8cfa34ad4000/lustre-OST0000_UUID 00000020:00000080:1.0:1787707410.820484:0:13178:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa34ad4000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787707410.820491:0:13178:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1787707410.820530:0:13178:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787707410.820535:0:13178:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787707410.820539:0:13178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787707410.820544:0:13178:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787707410.820552:0:13178:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8cf901156800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787707410.820557:0:13178:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8cfa359f19b8) has exports, disconnecting them 00000020:00080000:1.0:1787707410.820562:0:13178:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8cf901156800), last request at 1787707157 00000020:00000080:1.0:1787707410.820566:0:13178:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec0770 00000020:00080000:1.0:1787707410.820575:0:13178:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cf901156800): rc 0 00000020:00000080:1.0:1787707410.820579:0:13178:0:(genops.c:885:class_export_put()) final put ffff8cf901156800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787707410.820730:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa3fa31000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787707410.820742:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf901156800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787707410.872604:0:13178:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787707410.872614:0:13178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787707410.872619:0:13178:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787707410.872626:0:13178:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787707410.872830:0:13178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787707410.872839:0:13178:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1787707410.872845:0:13178:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfa34ab9800 1 00000020:00000080:3.0:1787707410.872851:0:13178:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec0700 00000020:00000080:3.0:1787707410.872860:0:13178:0:(genops.c:885:class_export_put()) final put ffff8cfa3a861800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787707410.872864:0:13178:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787707410.872868:0:13178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787707410.872871:0:13178:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787707410.872875:0:13178:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8cfa110e0000) has no exports 00000020:00000080:2.0:1787707410.873406:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cf901153000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787707410.873414:0:8:0:(genops.c:885:class_export_put()) final put ffff8cfa34aba800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787707410.873417:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa34aba800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787707410.873437:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787707410.873490:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa3a861800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787707410.906863:0:13178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787707410.906881:0:13178:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787707410.906888:0:13178:0:(genops.c:885:class_export_put()) final put ffff8cfa34ab8800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787707410.906894:0:13178:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa34ab8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787707410.906907:0:13178:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787707410.907136:0:13178:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cfa34abe800 00000020:02000400:0.0:1787707410.907195:0:13178:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787707411.704866:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707412.734342:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707413.754730:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787707414.106342:0:13333:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1787707414.115070:0:13333:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787707414.115775:0:13333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa08746000/0xc5f18d5f94ec090d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0914 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707414.115791:0:13333:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa08746000/0xc5f18d5f94ec090d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0914 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707414.115799:0:13333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa08746000/0xc5f18d5f94ec090d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec0914 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707414.115806:0:13333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.146@tcp lock: ffff8cfa08746000/0xc5f18d5f94ec090d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec0914 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707414.115830:0:13333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787707414.115836:0:13333:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787707414.115861:0:13333:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787707414.115872:0:13333:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfa2f152300 x1874546729773696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707416 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707414.115889:0:13333:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfa2f152d80 x1874546729773824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707421 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707414.115900:0:13333:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfa2f150a80 x1874546729774080/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707426 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707414.115910:0:13333:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787707414.115916:0:13333:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787707414.115941:0:13333:0:(import.c:65:import_set_state_nolock()) ffff8cfa06ea5800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787707414.115945:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787707414.115953:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa08746000/0xc5f18d5f94ec090d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec0914 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707414.115960:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa08746000 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:1.0:1787707414.115964:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa08746000/0xc5f18d5f94ec090d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec0914 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707414.115972:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874546729774208:0@lo:39:umount.0 00010000:00010000:1.0:1787707414.115972:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa08746000/0xc5f18d5f94ec090d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f18d5f94ec0914 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787707414.115989:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa08746000/0xc5f18d5f94ec090d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f18d5f94ec0914 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707414.115994:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787707414.115997:0:7630:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787707414.116000:0:7630:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787707414.116014:0:7630:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfa08a7d000 00010000:00010000:1.0:1787707414.116018:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa08746000/0xc5f18d5f94ec090d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f18d5f94ec0914 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707414.116023:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa08746000/0xc5f18d5f94ec090d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f18d5f94ec0914 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707414.116034:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707414.116035:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707414.116037:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1787707414.116040:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874546729774208 offset 0 length 224: 4 00000100:00100000:1.0:1787707414.116060:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874546729773824:0@lo:400:kworker.0 00000100:00100000:1.0:1787707414.118259:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874546729774080:0@lo:400:kworker.0 00000100:00100000:3.0:1787707414.118461:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f152300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729773696:0@lo:400:kworker.0 00010000:00010000:1.0:1787707414.776609:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707415.800632:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787707415.864635:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787707415.864647:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787707416.828682:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707417.848958:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707418.872553:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707419.897492:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707420.920623:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787707420.984629:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787707420.984641:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787707421.944531:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707422.968754:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707423.993989:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707424.378005:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787707414/real 1787707414] req@ffff8cfa2f154000 x1874546729774208/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787707424 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707424.378036:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfa2f154000 x1874546729774208/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787707424 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787707424.378065:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cfa06ea5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787707424.378082:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874546729774208:0@lo:39:umount.0 00000100:00080000:2.0:1787707424.378204:0:13333:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787707424.378209:0:13333:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787707424.378214:0:13333:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787707424.380403:0:13333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa08746e00/0xc5f18d5f94ec091b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0922 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707424.380424:0:13333:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa08746e00/0xc5f18d5f94ec091b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0922 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707424.380431:0:13333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa08746e00/0xc5f18d5f94ec091b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec0922 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707424.380438:0:13333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.146@tcp lock: ffff8cfa08746e00/0xc5f18d5f94ec091b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec0922 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707424.380550:0:13333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787707424.380558:0:13333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b000/0xc5f18d5f94ec0b52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec0b59 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707424.380565:0:13333:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b000/0xc5f18d5f94ec0b52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec0b59 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707424.380584:0:13333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b000/0xc5f18d5f94ec0b52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec0b59 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707424.380590:0:13333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b000/0xc5f18d5f94ec0b52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f18d5f94ec0b59 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707424.385330:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787707424.385345:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa08746e00/0xc5f18d5f94ec091b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec0922 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707424.385356:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa08746e00 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:0.0:1787707424.385360:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa08746e00/0xc5f18d5f94ec091b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec0922 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707424.385383:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa08746e00/0xc5f18d5f94ec091b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f18d5f94ec0922 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787707424.385391:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa08746e00/0xc5f18d5f94ec091b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f18d5f94ec0922 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707424.385416:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787707424.385419:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1787707424.385435:0:5845:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfa08a7d000 00010000:00010000:0.0:1787707424.385438:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa08746e00/0xc5f18d5f94ec091b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f18d5f94ec0922 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707424.385445:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa08746e00/0xc5f18d5f94ec091b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f18d5f94ec0922 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707424.385464:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787707424.385469:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b000/0xc5f18d5f94ec0b52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec0b59 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707424.385474:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b000 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:0.0:1787707424.385477:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b000/0xc5f18d5f94ec0b52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f18d5f94ec0b59 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707424.385484:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b000/0xc5f18d5f94ec0b52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f18d5f94ec0b59 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787707424.385490:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b000/0xc5f18d5f94ec0b52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f18d5f94ec0b59 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707424.385518:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787707424.385521:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1787707424.385525:0:5845:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfa08a7d000 00010000:00010000:0.0:1787707424.385528:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b000/0xc5f18d5f94ec0b52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f18d5f94ec0b59 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707424.385545:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707424.385547:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707424.385549:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707424.385954:0:13333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787707424.385963:0:13333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b000/0xc5f18d5f94ec0b52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f18d5f94ec0b59 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707424.385980:0:13333:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1787707424.385996:0:13333:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1787707424.385999:0:13333:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787707424.386026:0:13333:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787707424.386031:0:13333:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787707424.386038:0:13333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787707424.386045:0:13333:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787707424.386049:0:13333:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8cfa359f4d28) has no exports 00000020:00080000:2.0:1787707424.386077:0:13333:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8cfa359f4d28) has no exports 00000020:01000000:2.0:1787707424.387790:0:13333:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfa05d1c5a0 - data ffff8cfa3043cca8/ffff8cfa41998400 00000020:01000000:2.0:1787707424.387913:0:13333:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfa0312d360 - data ffff8cfa3fec8798/ffff8cf90125ac00 00010000:00010000:0.0:1787707424.388003:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1787707424.404823:0:13333:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787707424.429748:0:13333:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec0811 00000020:00000080:2.0:1787707424.429760:0:13333:0:(genops.c:885:class_export_put()) final put ffff8cfa419d6800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787707424.429778:0:13333:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfa3f9b5800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787707424.429782:0:13333:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfa3f9b5800 2 00000020:01000004:2.0:1787707424.429786:0:13333:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cfa3f9b5800 from lustre-OST0001 00000020:00000080:1.0:1787707424.429796:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa419d6800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787707424.429812:0:13333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787707424.429823:0:13333:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787707424.429837:0:13333:0:(genops.c:885:class_export_put()) final put ffff8cfa06ea7800/lustre-OST0001_UUID 00000020:00000080:2.0:1787707424.429839:0:13333:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa06ea7800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787707424.429846:0:13333:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1787707424.429923:0:13333:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d->MGS 00010000:00010000:2.0:1787707424.429940:0:13333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4c00/0xc5f18d5f94ec0723 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f18d5f94ec072a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787707424.429953:0:13333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4c00/0xc5f18d5f94ec0723 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f18d5f94ec072a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707424.429960:0:13333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787707424.429963:0:13333:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787707424.429966:0:13333:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787707424.429982:0:13333:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfa08a7d000 00010000:00010000:2.0:1787707424.429986:0:13333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa029d4c00/0xc5f18d5f94ec0723 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f18d5f94ec072a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707424.430001:0:13333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2a00/0xc5f18d5f94ec0961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f18d5f94ec0968 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787707424.430008:0:13333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2a00/0xc5f18d5f94ec0961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f18d5f94ec0968 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707424.430014:0:13333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787707424.430017:0:13333:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787707424.430018:0:13333:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787707424.430028:0:13333:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfa08a7d000 00010000:00010000:2.0:1787707424.430031:0:13333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd2a00/0xc5f18d5f94ec0961 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f18d5f94ec0968 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787707424.430046:0:13333:0:(import.c:65:import_set_state_nolock()) ffff8cfa08a7d000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787707424.430062:0:13333:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787707424.430064:0:13333:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787707424.430065:0:13333:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787707424.430069:0:13333:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787707424.430080:0:13333:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfa2f153100 x1874546729773952/t0(0) o250->MGC192.168.204.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787707425 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787707424.430091:0:13333:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787707424.430093:0:13333:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:0.0:1787707424.430576:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d:3313:1874546729773952:0@lo:250:kworker.0 10000000:01000000:1.0:1787707424.431753:0:13333:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787707424.431767:0:13333:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec0604 00000020:00000080:1.0:1787707424.431788:0:13333:0:(genops.c:885:class_export_put()) final put ffff8cfa08a78000/5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d 00000020:01000000:1.0:1787707424.431813:0:13333:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.146@tcp (flags='') 00000020:00000080:1.0:1787707424.431819:0:13333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787707424.431825:0:13333:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.146@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787707424.431829:0:13333:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8cfa05848000) has no exports 00000020:00000080:0.0:1787707424.431896:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa08a78000/5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d for MGC192.168.204.146@tcp 10000000:01000000:2.0:1787707424.432100:0:5853:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787707424.432189:0:13333:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.146@tcp: client import never connected 00000100:00080000:1.0:1787707424.432193:0:13333:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787707424.432195:0:13333:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787707424.432198:0:13333:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787707424.432200:0:13333:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787707424.432435:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfa08a7d000 for MGC192.168.204.146@tcp 00000020:00000080:1.0:1787707424.432501:0:13333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787707424.432509:0:13333:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.146@tcp (uuid 5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d) 00000020:00000080:1.0:1787707424.432512:0:13333:0:(genops.c:885:class_export_put()) final put ffff8cfa0b9fd000/5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d 00000020:00000080:1.0:1787707424.432515:0:13333:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa0b9fd000/5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d for MGC192.168.204.146@tcp 00000020:01000000:1.0:1787707424.432757:0:13333:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.146@tcp (5ea091a4-c7eb-4f8b-b493-bb7ea75ff04d) 00000020:01000000:1.0:1787707424.433036:0:13333:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787707424.433040:0:13333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787707424.433044:0:13333:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787707424.433050:0:13333:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8cfa419d7800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787707424.433056:0:13333:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8cf9022c19b8) has exports, disconnecting them 00000020:00080000:1.0:1787707424.433060:0:13333:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8cfa419d7800), last request at 1787707178 00000020:00000080:1.0:1787707424.433065:0:13333:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec083b 00000020:00080000:1.0:1787707424.433080:0:13333:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfa419d7800): rc 0 00000020:00000080:1.0:1787707424.433084:0:13333:0:(genops.c:885:class_export_put()) final put ffff8cfa419d7800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787707424.433679:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa419d7800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787707424.436433:0:13333:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787707424.436440:0:13333:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787707424.436444:0:13333:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787707424.436451:0:13333:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787707424.436676:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfa06ea5800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1787707424.438545:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787707424.438724:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787707424.438890:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787707424.439024:0:5839:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8cfa111dcc00:5839] 0 exiting: rc = 1 00000100:00100000:0.0:1787707424.439216:0:5840:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8cfa1f9e6e00:5840] 1 exiting: rc = 0 00000100:00100000:2.0:1787707424.441124:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707424.441568:0:5841:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8cfa103cbe00:5841] 0 exiting: rc = 1 00000100:00100000:2.0:1787707424.441669:0:5842:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8cfa103cb600:5842] 1 exiting: rc = 0 00000100:00100000:1.0:1787707424.441796:0:5843:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8cfa103ca000:5843] 2 exiting: rc = 0 00000100:00100000:3.0:1787707424.446730:0:8450:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8cfa41caf600:8450] 3 exiting: rc = 0 00000100:00100000:2.0:1787707424.446824:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447065:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447438:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447446:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447459:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447475:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447482:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447488:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447509:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447518:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447526:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447676:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447689:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447695:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447700:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447706:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447712:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447717:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447721:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447726:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447731:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447750:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447758:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447763:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447772:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447778:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.447782:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448095:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448104:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448119:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448124:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448129:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448134:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448139:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448144:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448149:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448154:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448158:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448163:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448167:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448172:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448177:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448182:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448260:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448267:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448272:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448276:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448281:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448286:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448293:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448298:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448304:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448310:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448315:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448321:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448326:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448341:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448347:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448352:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448358:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.448362:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.449028:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.449038:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.449044:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787707424.452367:0:13333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787707424.452409:0:13333:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787707424.453313:0:13333:0:(genops.c:885:class_export_put()) final put ffff8cfa419d4800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787707424.453320:0:13333:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa419d4800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787707424.453329:0:13333:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1787707424.453484:0:13333:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfa3f9b5800 1 00000020:00000080:0.0:1787707424.453500:0:13333:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f18d5f94ec07e0 00000020:00000080:0.0:1787707424.453507:0:13333:0:(genops.c:885:class_export_put()) final put ffff8cfa06ea6000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787707424.453522:0:13333:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787707424.453527:0:13333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787707424.453543:0:13333:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787707424.453547:0:13333:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8cfa073d4d28) has no exports 00000020:00000080:2.0:1787707424.453600:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa06ea6000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787707424.476772:0:13333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787707424.476790:0:13333:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787707424.476797:0:13333:0:(genops.c:885:class_export_put()) final put ffff8cfa3f9b1800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787707424.476802:0:13333:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa3f9b1800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787707424.476810:0:13333:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787707424.476989:0:13333:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cfa3f9b7800 00000020:01000000:0.0:1787707424.477008:0:13333:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787707424.477012:0:13333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787707424.477016:0:13333:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787707424.477021:0:13333:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8cfa058499b8) has no exports 00000020:00000080:0.0:1787707424.477046:0:13333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787707424.477052:0:13333:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787707424.477055:0:13333:0:(genops.c:885:class_export_put()) final put ffff8cfa3a867000/OSS_uuid 00000020:00000080:0.0:1787707424.477057:0:13333:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfa3a867000/OSS_uuid for OSS 00000020:01000000:0.0:1787707424.477061:0:13333:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1787707424.477149:0:5852:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787707424.477273:0:8265:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8cfa06e0ee00:8265] 3 exiting: rc = 0 00000100:00100000:2.0:1787707424.477307:0:12022:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8cfa3abf2600:12022] 4 exiting: rc = 0 00000100:00100000:3.0:1787707424.477354:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8cfa35a25600:6688] 0 exiting: rc = 1 00000100:00100000:2.0:1787707424.478468:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8cfa35a24800:6690] 2 exiting: rc = 0 00000100:00100000:0.0:1787707424.481814:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8cfa073c8600:6689] 1 exiting: rc = 0 00000100:00100000:2.0:1787707424.482403:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482419:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482428:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482436:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482442:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482448:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482455:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482463:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482469:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482475:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482480:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482485:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482502:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482509:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482514:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482519:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482525:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482530:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482535:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482541:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482546:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482551:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482556:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482577:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482582:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482587:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482592:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482597:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482603:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482609:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482614:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482620:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482625:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482630:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482635:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482640:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482645:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482650:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482655:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482660:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482664:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482670:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482675:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482680:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482685:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482694:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482700:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482706:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482711:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482716:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482721:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482727:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482732:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482737:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482742:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482747:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482751:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482756:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482768:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482773:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482778:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482782:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482787:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.482792:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.483981:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8cfa1116ba00:6692] 1 exiting: rc = 0 00000100:00100000:0.0:1787707424.483982:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8cfa05c7b200:6691] 0 exiting: rc = 1 00000100:00100000:2.0:1787707424.484183:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484193:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484202:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484208:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484214:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484218:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484223:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484229:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484233:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484464:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484474:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484483:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484502:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484510:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484519:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484531:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484540:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484549:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484560:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484569:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484578:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484589:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484599:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484608:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484616:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484623:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484631:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484639:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484648:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484687:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484702:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484710:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484719:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484726:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484732:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484737:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484742:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484748:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484754:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484759:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484763:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484769:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484773:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484776:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484779:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484783:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484787:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484790:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484793:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484795:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484799:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484802:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484805:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484807:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484810:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484813:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484816:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484819:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484822:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484826:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484829:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484832:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484835:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.484839:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.485943:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8cfa29a3b400:6695] 2 exiting: rc = 0 00000100:00100000:1.0:1787707424.486172:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8cfa416bc200:6694] 1 exiting: rc = 0 00000100:00100000:3.0:1787707424.486661:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8cfa05c7be00:6693] 0 exiting: rc = 1 00000100:00100000:2.0:1787707424.486776:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486783:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486788:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486794:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486798:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486803:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486809:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486814:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486819:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486825:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486831:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486837:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486842:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486848:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486854:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486868:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486875:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486880:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486884:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486890:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486895:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486899:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486905:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486911:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486916:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486921:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486926:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486932:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486938:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486944:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486951:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486957:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486961:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486966:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486984:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.486988:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487000:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487006:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487011:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487029:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487037:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487043:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487049:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487054:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487059:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487064:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487070:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487075:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487081:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487085:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487091:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487096:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487101:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487107:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487113:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487118:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487123:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487139:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487146:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487151:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487156:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487161:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487167:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787707424.487179:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787707424.492625:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8cfa34ee2200:6697] 1 exiting: rc = 0 00000100:00100000:2.0:1787707424.492808:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8cfa29a3aa00:6696] 0 exiting: rc = 1 00000100:00100000:3.0:1787707424.494660:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.494670:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.494676:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.494681:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.494686:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.494691:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.494696:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.494701:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.494706:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.494711:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.494716:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496110:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496129:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496135:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496141:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496146:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496168:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496173:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496178:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496183:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496188:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496193:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496198:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496203:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496208:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496225:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496231:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496236:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496241:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496245:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496250:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496256:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496261:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496266:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496271:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496276:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496280:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496285:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496290:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496295:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496300:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496304:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496309:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496315:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496320:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496326:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496332:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496338:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496347:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496354:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496362:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496653:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496659:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496664:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496668:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496673:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496678:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496683:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496689:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496694:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496699:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496704:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496709:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.496714:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787707424.500518:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8cfa34eca000:6698] 0 exiting: rc = 1 00000100:00100000:2.0:1787707424.501643:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8cfa34ecaa00:6699] 1 exiting: rc = 0 00000100:00100000:3.0:1787707424.501765:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502007:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502016:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502021:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502027:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502033:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502039:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502044:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502050:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502056:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502062:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502067:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502072:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502090:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502097:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502103:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502109:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502116:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502121:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502127:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502133:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502138:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502158:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502166:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502172:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502195:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502203:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502209:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502220:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502228:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502233:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502241:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502246:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502252:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502258:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502263:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502269:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502287:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502293:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502298:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502304:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502310:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502316:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502322:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502328:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502334:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502345:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502354:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502360:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502438:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502446:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502452:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502457:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502463:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502469:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502474:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502489:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502510:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502516:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502521:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502527:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502543:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502550:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787707424.502557:0:13333:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1787707424.518243:0:13333:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787707440.147734:0:13948:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg446-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787707448.045055:0:14410:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787707448.045062:0:14410:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787707448.045655:0:14410:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cfa2a55f000 00000020:01000004:3.0:1787707448.045672:0:14410:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787707448.045680:0:14410:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787707448.045694:0:14410:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8cfa058a99b8) 00000020:00000080:3.0:1787707448.045707:0:14410:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787707448.077819:0:14410:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787707448.082857:0:14410:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787707448.084513:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 377: rc = 0 00100000:10000000:2.0:1787707448.084627:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 377: rc = 0 00100000:10000000:2.0:1787707448.084740:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 377: rc = 0 00100000:10000000:2.0:1787707448.086012:0:14410:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787707448.086337:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 377: rc = 0 00100000:10000000:2.0:1787707448.086632:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 377: rc = 0 00100000:10000000:2.0:1787707448.086727:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 377: rc = 0 00100000:10000000:2.0:1787707448.087600:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 379: rc = 0 00100000:10000000:2.0:1787707448.094088:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 518: rc = 0 00100000:10000000:2.0:1787707448.095512:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 518: rc = 0 00100000:10000000:2.0:1787707448.097079:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 525: rc = 0 00100000:10000000:2.0:1787707448.097584:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 525: rc = 0 00100000:10000000:2.0:1787707448.098400:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 525: rc = 0 00100000:10000000:2.0:1787707448.100623:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 525: rc = 0 00100000:10000000:2.0:1787707448.101327:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 525: rc = 0 00100000:10000000:2.0:1787707448.102621:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 525: rc = 0 00100000:10000000:2.0:1787707448.103351:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 525: rc = 0 00100000:10000000:2.0:1787707448.104824:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 525: rc = 0 00100000:10000000:2.0:1787707448.105825:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 525: rc = 0 00100000:10000000:2.0:1787707448.106366:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 525: rc = 0 00100000:10000000:2.0:1787707448.108067:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 525: rc = 0 00100000:10000000:2.0:1787707448.108760:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 525: rc = 0 00100000:10000000:3.0:1787707448.114313:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 780: rc = 0 00100000:10000000:3.0:1787707448.114744:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 780: rc = 0 00100000:10000000:3.0:1787707448.115010:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 780: rc = 0 00100000:10000000:3.0:1787707448.115702:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 780: rc = 0 00100000:10000000:3.0:1787707448.116083:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 780: rc = 0 00100000:10000000:3.0:1787707448.116691:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 780: rc = 0 00100000:10000000:3.0:1787707448.117284:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 780: rc = 0 00100000:10000000:3.0:1787707448.117591:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 780: rc = 0 00100000:10000000:3.0:1787707448.118112:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 780: rc = 0 00100000:10000000:3.0:1787707448.118529:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 780: rc = 0 00100000:10000000:3.0:1787707448.118783:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 780: rc = 0 00100000:10000000:3.0:1787707448.119056:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 780: rc = 0 00100000:10000000:3.0:1787707448.119342:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 780: rc = 0 00100000:10000000:3.0:1787707448.119720:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 780: rc = 0 00100000:10000000:3.0:1787707448.119939:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 780: rc = 0 00100000:10000000:3.0:1787707448.120307:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 780: rc = 0 00100000:10000000:3.0:1787707448.121604:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 780: rc = 0 00100000:10000000:3.0:1787707448.121833:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 780: rc = 0 00100000:10000000:0.0:1787707448.123696:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 780: rc = 0 00100000:10000000:0.0:1787707448.124240:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 780: rc = 0 00100000:10000000:0.0:1787707448.124638:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 780: rc = 0 00100000:10000000:0.0:1787707448.124866:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 780: rc = 0 00100000:10000000:0.0:1787707448.125797:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 780: rc = 0 00100000:10000000:0.0:1787707448.129566:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 780: rc = 0 00100000:10000000:0.0:1787707448.129865:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 780: rc = 0 00100000:10000000:0.0:1787707448.130650:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 780: rc = 0 00100000:10000000:0.0:1787707448.130919:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 780: rc = 0 00100000:10000000:1.0:1787707448.131884:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 780: rc = 0 00100000:10000000:1.0:1787707448.132154:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 780: rc = 0 00100000:10000000:1.0:1787707448.132813:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 780: rc = 0 00100000:10000000:1.0:1787707448.133067:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 780: rc = 0 00100000:10000000:1.0:1787707448.133636:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 780: rc = 0 00100000:10000000:1.0:1787707448.134190:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 539: rc = 0 00100000:10000000:1.0:1787707448.137583:0:14410:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1787707448.137825:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 519: rc = 0 00100000:10000000:1.0:1787707448.141328:0:14410:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1787707448.141941:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 519: rc = 0 00100000:10000000:1.0:1787707448.142196:0:14410:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1787707448.142279:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 519: rc = 0 00100000:10000000:1.0:1787707448.147578:0:14410:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1787707448.147706:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 523: rc = 0 00100000:10000000:1.0:1787707448.147938:0:14410:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1787707448.148021:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 523: rc = 0 00100000:10000000:1.0:1787707448.150327:0:14410:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1787707448.150493:0:14410:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 523: rc = 0 00000020:00000080:1.0:1787707448.150787:0:14410:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787707448.150795:0:14410:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787707448.150805:0:14410:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f18d5f94ec1905 00000020:01000004:1.0:1787707448.150813:0:14410:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1787707448.150817:0:14410:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787707448.150822:0:14410:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cfa2a55f000 from MGS 00000020:01000004:1.0:1787707448.150826:0:14410:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787707448.150837:0:14410:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8cfa3add99b8) 00000020:00000080:1.0:1787707448.150847:0:14410:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787707448.151347:0:14410:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfa2a55f000 from MGS, refs=2 00080000:01000000:1.0:1787707448.151354:0:14410:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787707448.151359:0:14410:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f18d5f94ec1913 00000100:00100000:1.0:1787707448.151517:0:14410:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787707448.151656:0:14410:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787707448.151662:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787707448.152628:0:14410:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787707448.152636:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787707448.153565:0:14410:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787707448.153733:0:14410:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787707448.153738:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787707448.154787:0:14410:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787707448.154797:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787707448.155309:0:14410:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787707448.155315:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787707448.156232:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707448.156235:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707448.156238:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707448.156793:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707448.156796:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707448.156802:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707448.166102:0:14410:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787707448.167915:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787707448.180695:0:14410:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787707448.180719:0:14410:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787707448.180722:0:14410:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787707448.187399:0:14421:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787707448.187702:0:14410:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787707448.187804:0:14410:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787707448.188308:0:14410:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787707448.188933:0:14410:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787707448.189272:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787707448.189280:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787707448.190870:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787707448.190880:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787707448.193745:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787707448.193756:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1787707448.196395:0:14425:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1787707448.196609:0:14410:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787707448.196633:0:14410:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.146@tcp' 00000020:01000004:1.0:1787707448.196635:0:14410:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787707448.196664:0:14410:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.146@tcp (typ=mgc) 00000020:00000080:1.0:1787707448.196676:0:14410:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.146@tcp (ffff8cfa3add8000) 00000020:00000080:1.0:1787707448.196702:0:14410:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787707448.196774:0:14410:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf901153000@MGC192.168.204.146@tcp: add connection 192.168.204.146@tcp at head 00010000:00010000:1.0:1787707448.197634:0:14410:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.146@tcp-0 is initialized 00000040:01000000:1.0:1787707448.197643:0:14410:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.146@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787707448.199563:0:14426:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787707448.199642:0:14410:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.146@tcp (uuid a4807cb1-ea3f-4016-a232-153195075fb5) 00000020:00000080:1.0:1787707448.199664:0:14410:0:(genops.c:1385:class_connect()) connect: client a4807cb1-ea3f-4016-a232-153195075fb5, cookie 0xc5f18d5f94ec1921 00000100:00080000:1.0:1787707448.199674:0:14410:0:(import.c:510:import_select_connection()) MGC192.168.204.146@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787707448.199680:0:14410:0:(import.c:624:import_select_connection()) MGC192.168.204.146@tcp: import ffff8cf901153000 using connection 192.168.204.146@tcp/0@lo 00000100:00100000:1.0:1787707448.199717:0:14410:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfa2f150a80 x1874546729774336/t0(0) o250->MGC192.168.204.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787707448.199744:0:14410:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a4807cb1-ea3f-4016-a232-153195075fb5->MGS 00000020:01000004:1.0:1787707448.199766:0:14410:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787707448.199771:0:14410:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787707448.199784:0:14410:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8cfa3addb370) 00000020:00000080:1.0:1787707448.199795:0:14410:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787707448.202297:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a4807cb1-ea3f-4016-a232-153195075fb5:3313:1874546729774336:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787707448.202386:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707448.205593:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729774336 00000100:00100000:2.0:1787707448.205612:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729774336 00000100:00100000:2.0:1787707448.205660:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787707448.205668:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f059c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3313:x1874546729774336:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787707448.205695:0:14422:0:(ldlm_lib.c:1455:target_handle_connect()) MGS: connection from a4807cb1-ea3f-4016-a232-153195075fb5@0@lo t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:2.0:1787707448.205724:0:14422:0:(genops.c:1385:class_connect()) connect: client a4807cb1-ea3f-4016-a232-153195075fb5, cookie 0xc5f18d5f94ec192f 00000100:00080000:2.0:1787707448.205863:0:14422:0:(import.c:65:import_set_state_nolock()) ffff8cfa34ab8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787707448.205963:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f059c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+5:3313:x1874546729774336:12345-0@lo:250:mount.lustre.0 Request processed in 294us (3576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707448.205971:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787707448.205973:0:3313:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.146@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787707448.205982:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.146@tcp: connect to target with instance 0 00000100:00080000:0.0:1787707448.205989:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.146@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787707448.205994:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787707448.205997:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cf901153000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787707448.206000:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787707448.206017:0:3313:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787707448.206023:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a4807cb1-ea3f-4016-a232-153195075fb5:3313:1874546729774336:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787707448.221345:0:14410:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787707448.221569:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787707448.221577:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787707448.224691:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787707448.224702:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787707448.225057:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787707448.225063:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787707448.229553:0:14410:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787707448.229726:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787707448.229733:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787707448.231320:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787707448.231329:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787707448.316205:0:14410:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787707448.318238:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787707448.318246:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787707448.320128:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787707448.320139:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787707448.321651:0:14410:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787707448.321820:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787707448.321825:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787707448.327739:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787707448.327754:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787707448.335150:0:14410:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787707448.336170:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787707448.336179:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787707448.337658:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787707448.337732:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787707448.339320:0:14410:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787707448.339689:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787707448.339695:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787707448.340664:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787707448.340672:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787707448.375083:0:14410:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787707448.375666:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787707448.375673:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787707448.378669:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787707448.378681:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787707448.379925:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787707448.379935:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787707448.380954:0:14410:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787707448.380976:0:14410:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787707448.380982:0:14410:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.146@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787707448.381122:0:14410:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.146@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787707448.381155:0:14410:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.146@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787707448.381160:0:14410:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787707448.381165:0:14410:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787707448.381166:0:14410:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787707448.381167:0:14410:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787707448.381169:0:14410:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787707448.381170:0:14410:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787707448.381171:0:14410:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787707448.381173:0:14410:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787707448.381174:0:14410:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787707448.381175:0:14410:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787707448.381178:0:14410:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787707448.381180:0:14410:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787707448.381181:0:14410:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787707448.381182:0:14410:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787707448.381183:0:14410:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787707448.381185:0:14410:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787707448.381186:0:14410:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787707448.381187:0:14410:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787707448.381188:0:14410:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787707448.381189:0:14410:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787707448.381190:0:14410:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787707448.381235:0:14410:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787707448.381253:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729774464:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787707448.381318:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707448.381364:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f349a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787707448.381675:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729774464 00000100:00100000:2.0:1787707448.381684:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729774464 00000100:00100000:2.0:1787707448.381730:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787707448.381739:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f05b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+5:14410:x1874546729774464:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787707448.381786:0:14424:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787707448.381789:0:14424:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787707448.381793:0:14424:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787707448.382341:0:14445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787707448.382712:0:14424:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1787707448.387024:0:14446:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787707448.387033:0:14446:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787707448.387046:0:14446:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787707448.387084:0:14446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1787707448.389818:0:14424:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787707448.389831:0:14424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787707448.397815:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f05b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+5:14410:x1874546729774464:12345-0@lo:253:mount.lustre.0 Request processed in 16068us (16488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707448.397835:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787707448.397960:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729774464:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787707448.397975:0:14410:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787707448.397979:0:14410:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787707448.397980:0:14410:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787707448.397982:0:14410:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787707448.397983:0:14410:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787707448.397985:0:14410:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787707448.397986:0:14410:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787707448.397988:0:14410:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787707448.397989:0:14410:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787707448.397991:0:14410:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787707448.397993:0:14410:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787707448.398013:0:14410:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cfa2a55f000 from lustre-MDT0000 10000000:01000000:1.0:1787707448.398049:0:14410:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787707448.398064:0:14410:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787707448.398068:0:14410:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cfa3add8000 10000000:01000000:1.0:1787707448.398072:0:14410:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787707448.398080:0:14410:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cfa3add8000 from 1 10000000:01000000:1.0:1787707448.398083:0:14410:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787707448.398130:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15e00/0xc5f18d5f94ec1936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707448.398142:0:14410:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15e00/0xc5f18d5f94ec1936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707448.398153:0:14410:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15e00/0xc5f18d5f94ec1936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707448.398171:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729774592:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787707448.398205:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707448.398252:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f349c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787707448.398455:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729774592 00000100:00100000:3.0:1787707448.398462:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729774592 00000100:00100000:3.0:1787707448.398505:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787707448.398514:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f05b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+5:14410:x1874546729774592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787707448.398527:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707448.398541:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa421fd600/0xc5f18d5f94ec193d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec1936 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707448.398563:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa421fd600/0xc5f18d5f94ec193d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1936 expref: 6 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707448.398574:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa421fd600/0xc5f18d5f94ec193d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1936 expref: 6 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707448.398583:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fd600, rc 0) 00000100:00100000:3.0:1787707448.398612:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f05b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+6:14410:x1874546729774592:12345-0@lo:101:mount.lustre.0 Request processed in 100us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707448.398619:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787707448.398866:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729774592:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787707448.398880:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15e00/0xc5f18d5f94ec1936 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec193d expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707448.398891:0:14410:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15e00/0xc5f18d5f94ec1936 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec193d expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707448.398938:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729774720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787707448.398964:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707448.398991:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f349c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787707448.399339:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729774720 00000100:00100000:3.0:1787707448.399344:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729774720 00000100:00100000:3.0:1787707448.399415:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787707448.399423:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f059450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+6:14410:x1874546729774720:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787707448.399816:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f059450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+6:14410:x1874546729774720:12345-0@lo:501:mount.lustre.0 Request processed in 392us (850us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787707448.399825:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787707448.399910:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729774720:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787707448.399950:0:14410:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787707448.399980:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15e00/0xc5f18d5f94ec1936 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec193d expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707448.399989:0:14410:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15e00/0xc5f18d5f94ec1936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec193d expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707448.399996:0:14410:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cfa2a55f000 10000000:01000000:1.0:1787707448.400000:0:14410:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787707448.400003:0:14410:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cfa2a55f000 10000000:01000000:1.0:1787707448.400005:0:14410:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787707448.400008:0:14410:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cfa2a55f000 from 1 10000000:01000000:1.0:1787707448.400011:0:14410:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787707448.400030:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15c00/0xc5f18d5f94ec1944 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707448.400048:0:14410:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15c00/0xc5f18d5f94ec1944 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707448.400056:0:14410:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15c00/0xc5f18d5f94ec1944 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707448.400071:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729774848:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787707448.400109:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707448.400177:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f349c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787707448.400827:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729774848 00000100:00100000:2.0:1787707448.400834:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729774848 00000100:00100000:2.0:1787707448.400997:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787707448.401014:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f059850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+6:14410:x1874546729774848:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787707448.401025:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707448.401049:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa0871a000/0xc5f18d5f94ec194b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec1944 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.401069:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa0871a000/0xc5f18d5f94ec194b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1944 expref: 7 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.401079:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa0871a000/0xc5f18d5f94ec194b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1944 expref: 7 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.401150:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871a000, rc 0) 00000100:00100000:2.0:1787707448.401198:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f059850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+7:14410:x1874546729774848:12345-0@lo:101:mount.lustre.0 Request processed in 186us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707448.401204:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787707448.401309:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729774848:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787707448.401323:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15c00/0xc5f18d5f94ec1944 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec194b expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707448.401332:0:14410:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15c00/0xc5f18d5f94ec1944 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec194b expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707448.401354:0:14410:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787707448.401392:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15c00/0xc5f18d5f94ec1944 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec194b expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707448.401571:0:14410:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15c00/0xc5f18d5f94ec1944 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec194b expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707448.401581:0:14410:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787707448.401586:0:14410:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787707448.401591:0:14410:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cfa2a55f000 10000000:01000000:1.0:1787707448.401594:0:14410:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787707448.401596:0:14410:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787707448.401599:0:14410:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787707448.401617:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15000/0xc5f18d5f94ec1952 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707448.401625:0:14410:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15000/0xc5f18d5f94ec1952 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707448.401632:0:14410:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15000/0xc5f18d5f94ec1952 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707448.401647:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729774976:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787707448.401676:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707448.401804:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f349c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787707448.401876:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729774976 00000100:00100000:2.0:1787707448.401881:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729774976 00000100:00100000:2.0:1787707448.401909:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787707448.401924:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f059050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+7:14410:x1874546729774976:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787707448.401932:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707448.401941:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa0871b600/0xc5f18d5f94ec1959 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec1952 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.401957:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa0871b600/0xc5f18d5f94ec1959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1952 expref: 8 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.401966:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa0871b600/0xc5f18d5f94ec1959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1952 expref: 8 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.401983:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871b600, rc 0) 00000100:00100000:2.0:1787707448.402020:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f059050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+8:14410:x1874546729774976:12345-0@lo:101:mount.lustre.0 Request processed in 104us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707448.402026:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787707448.402320:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729774976:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787707448.402333:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15000/0xc5f18d5f94ec1952 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1959 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707448.402348:0:14410:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15000/0xc5f18d5f94ec1952 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec1959 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707448.402459:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729775104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787707448.402485:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707448.402506:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f349c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787707448.402656:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729775104 00000100:00100000:2.0:1787707448.402660:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729775104 00000100:00100000:2.0:1787707448.402678:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787707448.402684:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f058850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+8:14410:x1874546729775104:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787707448.403194:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f058850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+9:14410:x1874546729775104:12345-0@lo:501:mount.lustre.0 Request processed in 507us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707448.403201:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787707448.403437:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729775104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787707448.403472:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729775232:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787707448.403509:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707448.403529:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f349c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787707448.403689:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729775232 00000100:00100000:0.0:1787707448.403694:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729775232 00000100:00100000:0.0:1787707448.403719:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787707448.403732:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f05a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+9:14410:x1874546729775232:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787707448.404323:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f05a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+9:14410:x1874546729775232:12345-0@lo:503:mount.lustre.0 Request processed in 590us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707448.404331:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787707448.404639:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729775232:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787707448.405648:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f152d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a4807cb1-ea3f-4016-a232-153195075fb5:14447:1874546729775360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787707448.405702:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707448.405739:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f349d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787707448.411052:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729775360 00000100:00100000:2.0:1787707448.411068:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729775360 00000100:00100000:2.0:1787707448.411144:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787707448.411155:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+9:14447:x1874546729775360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787707448.411606:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+9:14447:x1874546729775360:12345-0@lo:502:llog_process_th.0 Request processed in 452us (5901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707448.411615:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787707448.411984:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f152d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a4807cb1-ea3f-4016-a232-153195075fb5:14447:1874546729775360:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787707448.412018:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787707448.412028:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707448.412031:0:14447:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787707448.412049:0:14447:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787707448.412052:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787707448.412065:0:14447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8cfa3addcd28) 00000020:00000080:1.0:1787707448.412082:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787707448.412096:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787707448.412163:0:14447:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787707448.412171:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f18d5f94ec1967 00000020:00000080:1.0:1787707448.412472:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787707448.412477:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787707448.412480:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707448.412482:0:14447:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787707448.412485:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787707448.412489:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707448.412490:0:14447:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787707448.412494:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787707448.412502:0:14447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8cfa058499b8) 00000020:00000080:1.0:1787707448.412512:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787707448.412515:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787707448.412517:0:14447:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787707448.412520:0:14447:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787707448.412526:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787707448.412580:0:14447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfa2a55f000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787707448.412593:0:14447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8cfa05848000) 00000020:00000080:1.0:1787707448.412601:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787707448.412642:0:14447:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787707448.412648:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f18d5f94ec197c 00000020:00000080:1.0:1787707448.412742:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787707448.412747:0:14447:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787707448.412752:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc5f18d5f94ec1983 00080000:01000000:1.0:1787707448.412757:0:14447:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787707448.412761:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f18d5f94ec198a 00010000:00010000:2.0:1787707448.466129:0:14447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787707448.466785:0:14447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1787707448.466968:0:14447:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787707448.467634:0:14447:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8cfa073d0000) 00000020:00000080:2.0:1787707448.467653:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787707448.467735:0:14447:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787707448.467743:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f18d5f94ec1998 00000020:00000080:2.0:1787707448.469346:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787707448.476506:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc5f18d5f94ec199f 00000020:00000080:1.0:1787707448.478067:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787707448.478079:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787707448.478087:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707448.478089:0:14447:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787707448.478093:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787707448.478108:0:14447:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1787707448.478110:0:14447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787707448.478112:0:14447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787707448.478114:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787707448.478117:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707448.478125:0:14447:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787707448.478128:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787707448.478133:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707448.478134:0:14447:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787707448.478140:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787707448.478178:0:14447:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787707448.478190:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787707448.478193:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707448.478195:0:14447:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787707448.478198:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787707448.478201:0:14447:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787707448.478205:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707448.478206:0:14447:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787707448.478209:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787707448.478214:0:14447:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.146@tcp to nid 0x20000c0a8cc92 (192.168.204.146@tcp) 00000020:01000000:1.0:1787707448.478239:0:14447:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787707448.478243:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787707448.478257:0:14447:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cfa0584b370) 00000020:00000080:1.0:1787707448.478273:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787707448.478278:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787707448.478329:0:14447:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787707448.478334:0:14447:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787707448.478340:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f18d5f94ec19ad 00010000:00080000:1.0:1787707448.478397:0:14447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfa2503f800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.146@tcp at head 00010000:00010000:1.0:1787707448.480497:0:14447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1787707448.481906:0:14447:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787707448.481972:0:14447:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787707448.483525:0:14447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787707448.483788:0:14447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787707448.484003:0:14447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787707448.484833:0:14451:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787707448.484839:0:14451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787707448.486586:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787707448.486601:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787707448.486642:0:14447:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787707448.486662:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f18d5f94ec19b4 00000100:00080000:1.0:1787707448.486672:0:14447:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787707448.486677:0:14447:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cfa2503f800 using connection 192.168.204.146@tcp/0@lo 00000100:00100000:1.0:1787707448.486711:0:14447:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfa2f152d80 x1874546729775488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787707448.486739:0:14447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787707448.486793:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787707448.486798:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707448.486800:0:14447:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787707448.486804:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787707448.486807:0:14447:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1787707448.486808:0:14447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787707448.486810:0:14447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787707448.486811:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787707448.486814:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707448.486816:0:14447:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787707448.486818:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787707448.486821:0:14447:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787707448.486825:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707448.486826:0:14447:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787707448.486829:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787707448.486833:0:14447:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.146@tcp to nid 0x20000c0a8cc92 (192.168.204.146@tcp) 00000020:01000000:1.0:1787707448.486855:0:14447:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787707448.486858:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787707448.486869:0:14447:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cfa0584cd28) 00000020:00000080:1.0:1787707448.486879:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787707448.486884:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1787707448.486927:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729775488:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1787707448.486945:0:14447:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787707448.486952:0:14447:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787707448.486959:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f18d5f94ec19c2 00000400:00000100:0.0:1787707448.486989:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874546729775488 offset 0 length 520: 4 00010000:00080000:1.0:1787707448.486998:0:14447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfa35b35800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.146@tcp at head 00010000:00010000:1.0:1787707448.487230:0:14447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787707448.487483:0:14447:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787707448.487509:0:14447:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787707448.488106:0:14447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787707448.488165:0:14447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787707448.488253:0:14447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1787707448.488848:0:14453:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787707448.488853:0:14453:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787707448.490946:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787707448.490959:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787707448.490999:0:14447:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787707448.491018:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f18d5f94ec19c9 00000100:00080000:2.0:1787707448.491029:0:14447:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787707448.491045:0:14447:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cfa35b35800 using connection 192.168.204.146@tcp/0@lo 00000100:00100000:2.0:1787707448.491080:0:14447:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfa2f154700 x1874546729775616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787707448.491108:0:14447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1787707448.491223:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729775616:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787707448.491278:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874546729775616 offset 0 length 520: 4 00000020:01000000:2.0:1787707448.491426:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787707448.491446:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707448.491449:0:14447:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787707448.491452:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787707448.491456:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707448.491457:0:14447:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787707448.491460:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787707448.491462:0:14447:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787707448.491466:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787707448.491469:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707448.491470:0:14447:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787707448.491473:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787707448.491475:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707448.491477:0:14447:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787707448.491481:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787707448.491510:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f155c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a4807cb1-ea3f-4016-a232-153195075fb5:14447:1874546729775744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787707448.491576:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707448.491600:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f5eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787707448.491665:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729775744 00000100:00100000:3.0:1787707448.491672:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729775744 00000100:00100000:3.0:1787707448.491713:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787707448.491723:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+9:14447:x1874546729775744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787707448.491969:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+9:14447:x1874546729775744:12345-0@lo:502:llog_process_th.0 Request processed in 247us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707448.491976:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787707448.492327:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f155c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a4807cb1-ea3f-4016-a232-153195075fb5:14447:1874546729775744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787707448.492355:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787707448.492361:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707448.492362:0:14447:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787707448.492366:0:14447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787707448.494922:0:14410:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1787707448.494955:0:14410:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787707448.494985:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15000/0xc5f18d5f94ec1952 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1959 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707448.495000:0:14410:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15000/0xc5f18d5f94ec1952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1959 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787707448.495010:0:14410:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfa2a55f000 from 1 10000000:01000000:3.0:1787707448.495014:0:14410:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787707448.495067:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc600/0xc5f18d5f94ec19d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707448.495091:0:14410:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc600/0xc5f18d5f94ec19d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707448.495103:0:14410:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc600/0xc5f18d5f94ec19d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707448.495128:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08772300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729775872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787707448.495185:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707448.495504:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729775872 00000100:00100000:1.0:1787707448.495512:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729775872 00000100:00100000:1.0:1787707448.495549:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787707448.495558:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+9:14410:x1874546729775872:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787707448.495569:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707448.495582:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa41a14800/0xc5f18d5f94ec19d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec19d0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707448.495604:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa41a14800/0xc5f18d5f94ec19d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec19d0 expref: 10 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707448.495615:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa41a14800/0xc5f18d5f94ec19d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec19d0 expref: 10 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707448.495624:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a14800, rc 0) 00000100:00100000:3.0:1787707448.495734:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41fe23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707448.503478:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+10:14410:x1874546729775872:12345-0@lo:101:mount.lustre.0 Request processed in 7912us (8284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707448.503491:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787707448.503587:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08772300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729775872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787707448.503614:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc600/0xc5f18d5f94ec19d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec19d7 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707448.503628:0:14410:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc600/0xc5f18d5f94ec19d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec19d7 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707448.504215:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08772300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729776000:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787707448.504267:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707448.504307:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41fe23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707448.506024:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729776000 00000100:00100000:0.0:1787707448.506048:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729776000 00000100:00100000:0.0:1787707448.506105:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787707448.506114:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+10:14410:x1874546729776000:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787707448.506135:0:14424:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787707448.506143:0:14424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787707448.506242:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+10:14410:x1874546729776000:12345-0@lo:256:mount.lustre.0 Request processed in 129us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707448.506249:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787707448.506563:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08772300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729776000:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787707448.507157:0:14410:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787707448.507182:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc600/0xc5f18d5f94ec19d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec19d7 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707448.507194:0:14410:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc600/0xc5f18d5f94ec19d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec19d7 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787707448.507218:0:14410:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfa2a55f000 from 1 10000000:01000000:3.0:1787707448.507221:0:14410:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787707448.507256:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec19de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707448.507264:0:14410:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec19de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707448.507275:0:14410:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec19de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707448.507295:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08772300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729776128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787707448.507334:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707448.507421:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41fe23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707448.507565:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729776128 00000100:00100000:0.0:1787707448.507570:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729776128 00000100:00100000:0.0:1787707448.507605:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787707448.507612:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+10:14410:x1874546729776128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787707448.507622:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707448.507641:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa3f8dbe00/0xc5f18d5f94ec19e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec19de expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707448.507663:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa3f8dbe00/0xc5f18d5f94ec19e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec19de expref: 11 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707448.507673:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa3f8dbe00/0xc5f18d5f94ec19e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec19de expref: 11 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707448.507683:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3f8dbe00, rc 0) 00000100:00100000:0.0:1787707448.507721:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+11:14410:x1874546729776128:12345-0@lo:101:mount.lustre.0 Request processed in 109us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707448.507727:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787707448.508233:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08772300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729776128:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787707448.508248:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec19de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec19e5 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707448.508257:0:14410:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec19de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec19e5 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707448.508307:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08772300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729776256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787707448.508332:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707448.508359:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41fe23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707448.508452:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729776256 00000100:00100000:0.0:1787707448.508457:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729776256 00000100:00100000:0.0:1787707448.508478:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787707448.508484:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+11:14410:x1874546729776256:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787707448.509176:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+11:14410:x1874546729776256:12345-0@lo:501:mount.lustre.0 Request processed in 691us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707448.509184:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787707448.509258:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08772300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729776256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787707448.509283:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08772300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729776384:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787707448.509320:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707448.509345:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41fe23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787707448.509403:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729776384 00000100:00100000:2.0:1787707448.509408:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729776384 00000100:00100000:2.0:1787707448.509455:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787707448.509469:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+11:14410:x1874546729776384:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787707448.509599:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+11:14410:x1874546729776384:12345-0@lo:503:mount.lustre.0 Request processed in 131us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707448.509606:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787707448.510201:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08772300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729776384:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787707448.510679:0:14455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a4807cb1-ea3f-4016-a232-153195075fb5:14455:1874546729776512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787707448.510715:0:14455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707448.510742:0:14455:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa111b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787707448.510786:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729776512 00000100:00100000:3.0:1787707448.510790:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729776512 00000100:00100000:3.0:1787707448.510826:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787707448.510833:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+11:14455:x1874546729776512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787707448.511282:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+11:14455:x1874546729776512:12345-0@lo:502:llog_process_th.0 Request processed in 447us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707448.511289:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787707448.511363:0:14455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a4807cb1-ea3f-4016-a232-153195075fb5:14455:1874546729776512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787707448.511437:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787707448.511446:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707448.511448:0:14455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787707448.511454:0:14455:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfa2a55f000 00000020:00000080:1.0:1787707448.511457:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787707448.511464:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787707448.511467:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707448.511468:0:14455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787707448.511470:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787707448.511472:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707448.511474:0:14455:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787707448.511477:0:14455:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfa2a55f000 00000020:00000080:1.0:1787707448.511479:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787707448.511530:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787707448.511533:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707448.511535:0:14455:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787707448.511537:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787707448.511540:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787707448.511541:0:14455:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787707448.511545:0:14455:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfa2a55f000 00000020:00000080:1.0:1787707448.511546:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787707448.511577:0:14455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f150000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a4807cb1-ea3f-4016-a232-153195075fb5:14455:1874546729776640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787707448.511610:0:14455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707448.511629:0:14455:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f650c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707448.516525:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729776640 00000100:00100000:0.0:1787707448.516536:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729776640 00000100:00100000:0.0:1787707448.516585:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787707448.516593:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+11:14455:x1874546729776640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787707448.516847:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+11:14455:x1874546729776640:12345-0@lo:502:llog_process_th.0 Request processed in 254us (5235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707448.516860:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787707448.516924:0:14455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f150000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a4807cb1-ea3f-4016-a232-153195075fb5:14455:1874546729776640:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787707448.516954:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787707448.516961:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707448.516963:0:14455:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787707448.516970:0:14455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787707448.524722:0:14410:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787707448.524757:0:14410:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787707448.524851:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec19de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec19e5 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.524866:0:14410:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec19de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec19e5 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707448.524919:0:14410:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787707448.524922:0:14410:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cfa2a55f000 10000000:01000000:2.0:1787707448.524925:0:14410:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cfa2a55f000 10000000:01000000:2.0:1787707448.524929:0:14410:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787707448.524934:0:14410:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfa2a55f000 from 1 10000000:01000000:2.0:1787707448.524937:0:14410:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787707448.524972:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b800/0xc5f18d5f94ec19ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.524981:0:14410:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b800/0xc5f18d5f94ec19ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.524992:0:14410:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b800/0xc5f18d5f94ec19ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707448.525016:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f156300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729776768:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787707448.525090:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707448.546081:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729776768 00000100:00100000:0.0:1787707448.546094:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729776768 00000100:00100000:0.0:1787707448.546154:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787707448.546164:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+11:14410:x1874546729776768:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787707448.546180:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707448.546196:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa3f8dbc00/0xc5f18d5f94ec19f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec19ec expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707448.546223:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa3f8dbc00/0xc5f18d5f94ec19f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec19ec expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707448.546234:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa3f8dbc00/0xc5f18d5f94ec19f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec19ec expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707448.546244:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3f8dbc00, rc 0) 00000100:00100000:0.0:1787707448.546295:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+12:14410:x1874546729776768:12345-0@lo:101:mount.lustre.0 Request processed in 133us (21206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707448.546302:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787707448.546405:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f5ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787707448.546440:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f156300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729776768:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787707448.546456:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b800/0xc5f18d5f94ec19ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec19f3 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707448.546466:0:14410:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b800/0xc5f18d5f94ec19ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec19f3 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707448.546536:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08772300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729776896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787707448.546567:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707448.546582:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa02f11000 going to sleep for 11 seconds 00000100:00100000:0.0:1787707448.546684:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729776896 00000100:00100000:0.0:1787707448.546689:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729776896 00000100:00100000:0.0:1787707448.546711:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787707448.546717:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+12:14410:x1874546729776896:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787707448.547395:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+12:14410:x1874546729776896:12345-0@lo:501:mount.lustre.0 Request processed in 651us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707448.547403:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787707448.551468:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08772300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729776896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787707448.551530:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08772300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729777024:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787707448.551603:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707448.551640:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa02f11000 going to sleep for 11 seconds 00000100:00100000:2.0:1787707448.552139:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729777024 00000100:00100000:2.0:1787707448.552149:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729777024 00000100:00100000:2.0:1787707448.552228:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787707448.552242:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+12:14410:x1874546729777024:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787707448.552470:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+12:14410:x1874546729777024:12345-0@lo:503:mount.lustre.0 Request processed in 232us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707448.552479:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787707448.552644:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08772300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729777024:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787707448.557799:0:14461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a4807cb1-ea3f-4016-a232-153195075fb5:14461:1874546729777152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787707448.557890:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707448.557928:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729777152 00000100:00100000:0.0:1787707448.557935:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729777152 00000100:00100000:0.0:1787707448.557986:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787707448.557995:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+12:14461:x1874546729777152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787707448.558300:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+12:14461:x1874546729777152:12345-0@lo:502:llog_process_th.0 Request processed in 305us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707448.558308:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787707448.558355:0:14461:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa11186840 going to sleep for 11 seconds 00000100:00100000:0.0:1787707448.558403:0:14461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a4807cb1-ea3f-4016-a232-153195075fb5:14461:1874546729777152:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787707448.558533:0:14461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787707448.558547:0:14461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8cf9022c19b8) 00000020:00000080:0.0:1787707448.558612:0:14461:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1787707448.558700:0:14461:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfa2a55f000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787707448.558704:0:14461:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfa2a55f000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787707448.558707:0:14461:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfa2a55f000 4 00010000:00080000:0.0:1787707448.558734:0:14461:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfa3f9b4800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.146@tcp at head 00010000:00010000:0.0:1787707448.562715:0:14461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1787707448.562915:0:14461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787707448.562958:0:14461:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787707448.562972:0:14461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc5f18d5f94ec1a01 00000100:00080000:0.0:1787707448.562983:0:14461:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787707448.562996:0:14461:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cfa3f9b4800 using connection 192.168.204.146@tcp/0@lo 00000100:00100000:0.0:1787707448.563109:0:14461:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfa3a57f480 x1874546729777280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787707448.563156:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874546729777280:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787707448.563423:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707448.563578:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729777280 00000100:00100000:0.0:1787707448.563585:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729777280 00000100:00100000:0.0:1787707448.563613:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787707448.563621:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874546729777280:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787707448.563668:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874546729777280:12345-0@lo:38:llog_process_th.0 Request processed in 46us (245us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787707448.563675:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787707448.563712:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787707448.563720:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cfa3f9b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787707448.563736:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787707448.563741:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874546729777280:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787707448.563777:0:14461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787707448.567096:0:14461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08772300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a4807cb1-ea3f-4016-a232-153195075fb5:14461:1874546729777408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787707448.567175:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707448.567235:0:14461:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa02f11000 going to sleep for 11 seconds 00000100:00100000:1.0:1787707448.567337:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729777408 00000100:00100000:1.0:1787707448.567345:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729777408 00000100:00100000:1.0:1787707448.567422:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787707448.567433:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+12:14461:x1874546729777408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787707448.567678:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+12:14461:x1874546729777408:12345-0@lo:502:llog_process_th.0 Request processed in 246us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707448.567695:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787707448.567803:0:14461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08772300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a4807cb1-ea3f-4016-a232-153195075fb5:14461:1874546729777408:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787707448.567829:0:14461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787707448.568539:0:14410:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787707448.568564:0:14410:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787707448.568583:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b800/0xc5f18d5f94ec19ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec19f3 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707448.568595:0:14410:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa0871b800/0xc5f18d5f94ec19ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec19f3 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787707448.568652:0:14410:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787707448.568654:0:14410:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787707448.568656:0:14410:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787707448.568657:0:14410:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787707448.568658:0:14410:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787707448.568660:0:14410:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787707448.568661:0:14410:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787707448.568663:0:14410:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787707448.568665:0:14410:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787707448.568666:0:14410:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787707448.568670:0:14410:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787707448.568672:0:14410:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787707448.568674:0:14410:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787707448.568675:0:14410:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787707448.568676:0:14410:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787707448.568677:0:14410:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787707448.568679:0:14410:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787707448.568680:0:14410:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787707448.568681:0:14410:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787707448.568682:0:14410:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787707448.568683:0:14410:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787707448.568700:0:14410:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787707448.568713:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f150000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729777536:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787707448.568753:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707448.568783:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa3acaeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787707448.570418:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729777536 00000100:00100000:3.0:1787707448.570429:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729777536 00000100:00100000:3.0:1787707448.570470:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787707448.570481:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+12:14410:x1874546729777536:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787707448.570509:0:14423:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787707448.570524:0:14423:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787707448.621851:0:14423:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787707448.622342:0:14423:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787707448.636867:0:14445:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787707448.636878:0:14445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787707448.636964:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec1a08 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707448.636985:0:14445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa41a14800/0xc5f18d5f94ec19d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec19d0 expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707448.636994:0:14445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec1a08 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707448.637060:0:14445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa41a14800/0xc5f18d5f94ec19d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec19d0 expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707448.637075:0:14445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfa41a14800/0xc5f18d5f94ec19d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec19d0 expref: 12 pid: 14423 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707448.637089:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08772300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14445:1874546729777664:0@lo:104: 00000100:00100000:3.0:1787707448.637170:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707448.637226:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa02f11300 going to sleep for 11 seconds 00000100:00100000:2.0:1787707448.637676:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729777664 00000100:00100000:2.0:1787707448.637684:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729777664 00000100:00100000:3.0:1787707448.650066:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787707448.650091:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08770a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a4807cb1-ea3f-4016-a232-153195075fb5+3:14445:x1874546729777664:12345-0@lo:104: 00010000:00010000:3.0:1787707448.650112:0:14412:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc600/0xc5f18d5f94ec19d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec19d7 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707448.650212:0:14412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787707448.650219:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08770a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a4807cb1-ea3f-4016-a232-153195075fb5+3:14445:x1874546729777664:12345-0@lo:104: Request processed in 141us (13050us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707448.650227:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787707448.651647:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787707448.651657:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc600/0xc5f18d5f94ec19d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec19d7 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.651668:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc600 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:2.0:1787707448.651673:0:14418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc600/0xc5f18d5f94ec19d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec19d7 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.651684:0:14418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc600/0xc5f18d5f94ec19d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec19d7 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787707448.651693:0:14418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc600/0xc5f18d5f94ec19d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec19d7 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707448.651699:0:14418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787707448.651762:0:14418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc600/0xc5f18d5f94ec19d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec19d7 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.651769:0:14418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787707448.651807:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc600/0xc5f18d5f94ec19d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec19d7 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.651814:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa421fc600/0xc5f18d5f94ec19d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec19d7 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.651835:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707448.651837:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707448.651839:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707448.651876:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a4807cb1-ea3f-4016-a232-153195075fb5:3314:1874546729777792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787707448.651933:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707448.652028:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729777792 00000100:00100000:2.0:1787707448.652047:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729777792 00010000:00010000:2.0:1787707448.652076:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa41a14800/0xc5f18d5f94ec19d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec19d0 expref: 13 pid: 14423 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707448.652104:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787707448.652112:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f155180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4807cb1-ea3f-4016-a232-153195075fb5+13:3314:x1874546729777792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787707448.652124:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707448.652130:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa41a14800/0xc5f18d5f94ec19d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec19d0 expref: 13 pid: 14423 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.652142:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa41a14800/0xc5f18d5f94ec19d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec19d0 expref: 13 pid: 14423 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.652161:0:14414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec1a08 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.652169:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec1a08 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787707448.652195:0:14414:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015317522s 00010000:00010000:2.0:1787707448.652199:0:14414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec1a08 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.652219:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec1a08 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.652225:0:14414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec1a08 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.652231:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec1a08 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.652237:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fda00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707448.652241:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec1a08 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.652248:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec1a08 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.652257:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec1a08 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.652266:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707448.652299:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f155180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4807cb1-ea3f-4016-a232-153195075fb5+13:3314:x1874546729777792:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707448.652306:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787707448.652341:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a4807cb1-ea3f-4016-a232-153195075fb5:3314:1874546729777792:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787707448.652405:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa41a14800/0xc5f18d5f94ec19d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec19d0 expref: 12 pid: 14423 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707448.652430:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08772300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14445:1874546729777664:0@lo:104: 00010000:00010000:2.0:1787707448.652445:0:14445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec1a08 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.652454:0:14445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec1a08 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.652460:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec1a08 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707448.652466:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa421fda00/0xc5f18d5f94ec1a08 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707448.660832:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+11:14410:x1874546729777536:12345-0@lo:253:mount.lustre.0 Request processed in 90344us (92069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707448.660848:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787707448.661129:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f150000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:14410:1874546729777536:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787707448.661145:0:14410:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787707448.661149:0:14410:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787707448.661151:0:14410:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787707448.661152:0:14410:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787707448.661153:0:14410:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787707448.661154:0:14410:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787707448.661156:0:14410:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787707448.661157:0:14410:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787707448.661159:0:14410:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787707448.661161:0:14410:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787707448.661175:0:14410:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787707448.661189:0:14410:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787707448.680172:0:14410:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787707448.680410:0:14410:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787707448.687329:0:14410:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787707448.690871:0:14410:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787707448.691646:0:14410:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787707448.693168:0:14410:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787707448.696959:0:14410:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787707448.697353:0:14410:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787707448.698187:0:14410:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787707448.698513:0:14410:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787707448.698784:0:14410:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787707448.698940:0:14410:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1787707448.759801:0:14410:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787707448.760420:0:14410:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1787707448.760883:0:14469:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787707448.763156:0:14469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1787707448.767307:0:14468:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787707448.767314:0:14468:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1787707448.767619:0:14410:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787707448.768456:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787707448.768521:0:14469:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787707448.768526:0:14469:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1787707448.768821:0:14410:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787707448.770082:0:14410:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787707448.770097:0:14410:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787707448.770459:0:14410:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787707448.772349:0:14410:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787707448.773357:0:14410:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787707448.773522:0:14410:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1787707448.776132:0:14410:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1787707448.797946:0:14410:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787707448.929930:0:14410:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787707448.929969:0:14410:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9ec6818fb988 00100000:10000000:2.0:1787707448.929977:0:14410:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787707448.931160:0:14410:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787707448.931177:0:14410:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.146@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787707448.931210:0:14410:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787707448.931228:0:14410:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787707449.209999:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787707449.594302:0:14460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1787707450.168462:0:14426:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787707450.168478:0:14426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfa2a55f000 from 6 10000000:01000000:3.0:1787707450.168483:0:14426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787707450.168531:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fda00/0xc5f18d5f94ec1a0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707450.168541:0:14426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa421fda00/0xc5f18d5f94ec1a0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707450.168552:0:14426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa421fda00/0xc5f18d5f94ec1a0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707450.168576:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08773480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729777920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787707450.168638:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707450.168720:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa08cc7780 going to sleep for 11 seconds 00000100:00100000:1.0:1787707450.168892:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729777920 00000100:00100000:1.0:1787707450.168900:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729777920 00000100:00100000:1.0:1787707450.168950:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787707450.168960:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+11:14426:x1874546729777920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787707450.168972:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707450.168986:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa41a14200/0xc5f18d5f94ec1a16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec1a0f expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707450.169025:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa41a14200/0xc5f18d5f94ec1a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1a0f expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707450.169037:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa41a14200/0xc5f18d5f94ec1a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1a0f expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707450.169045:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a14200, rc 0) 00000100:00100000:1.0:1787707450.169101:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+12:14426:x1874546729777920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707450.169107:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787707450.169501:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08773480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729777920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787707450.169520:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa421fda00/0xc5f18d5f94ec1a0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1a16 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707450.169529:0:14426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fda00/0xc5f18d5f94ec1a0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec1a16 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707450.169580:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08773480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729778048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787707450.169609:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707450.169641:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa08cc7780 going to sleep for 11 seconds 00000100:00100000:0.0:1787707450.169739:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729778048 00000100:00100000:0.0:1787707450.169745:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729778048 00000100:00100000:0.0:1787707450.169776:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787707450.169791:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf9012b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+12:14426:x1874546729778048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787707450.169805:0:14423:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787707450.169823:0:14423:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787707450.169826:0:14423:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787707450.169907:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf9012b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+12:14426:x1874546729778048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707450.169914:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787707450.172923:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08773480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729778048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787707450.172989:0:14426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787707450.173000:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fda00/0xc5f18d5f94ec1a0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1a16 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707450.173033:0:14426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa421fda00/0xc5f18d5f94ec1a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1a16 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707450.240117:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787707450.619340:0:14460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787707451.258467:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707452.280564:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707453.305824:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787707453.756989:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787707453.756996:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787707453.756999:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787707453.757001:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787707453.757004:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787707453.757007:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787707453.757010:0:38:0:(import.c:65:import_set_state_nolock()) ffff8cfa3f9b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787707453.757024:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cfa3f9b4800 using connection 192.168.204.146@tcp/0@lo 00000100:00100000:0.0:1787707453.757047:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfa3a57d180 x1874546729778304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787707453.757083:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874546729778304:0@lo:38:kworker.0 00000100:00100000:0.0:1787707453.757251:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707453.757317:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729778304 00000100:00100000:0.0:1787707453.757324:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787707453.757327:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729778304 00000100:00100000:0.0:1787707453.757334:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a4807cb1-ea3f-4016-a232-153195075fb5:3314:1874546729778176:0@lo:400:kworker.0 00000100:00100000:3.0:1787707453.757367:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787707453.757390:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707453.757403:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1874546729778304:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787707453.757430:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729778176 00000100:00100000:0.0:1787707453.757434:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729778176 00010000:00080000:3.0:1787707453.757442:0:14431:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000100:00100000:0.0:1787707453.757477:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000020:00000080:3.0:1787707453.757479:0:14431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc5f18d5f94ec1a1d 00000100:00100000:0.0:1787707453.757488:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf9012b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+12:3314:x1874546729778176:12345-0@lo:400:kworker.0 00000004:00100000:3.0:1787707453.757497:0:14431:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1787707453.757556:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf9012b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+12:3314:x1874546729778176:12345-0@lo:400:kworker.0 Request processed in 71us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707453.757564:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787707453.757611:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a4807cb1-ea3f-4016-a232-153195075fb5:3314:1874546729778176:0@lo:400:kworker.0 00000100:00080000:3.0:1787707453.757652:0:14431:0:(import.c:65:import_set_state_nolock()) ffff8cfa05d2f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787707453.757706:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874546729778304:12345-0@lo:38:kworker.0 Request processed in 303us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707453.757714:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787707453.757719:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cfa3a57d180 x1874546729778304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787707463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787707453.757733:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787707453.757740:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787707453.757744:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787707453.757747:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cfa3f9b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787707453.757752:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874546729778304:0@lo:38:kworker.0 00010000:00010000:3.0:1787707454.329620:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787707455.270104:0:14712:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg446-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787707455.367136:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707456.381824:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707457.403825:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707458.435659:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707458.872689:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787707448/real 1787707448] req@ffff8cfa2f154700 x1874546729775616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787707458 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707458.872736:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfa2f154700 x1874546729775616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787707458 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707458.872769:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787707448/real 1787707448] req@ffff8cfa2f152d80 x1874546729775488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787707458 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707458.872782:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfa2f152d80 x1874546729775488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787707458 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787707458.872798:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cfa35b35800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787707458.872807:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787707458.872811:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729775616:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787707458.872816:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cfa2503f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787707458.872820:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787707458.872823:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729775488:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787707458.876017:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787707458.876023:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787707458.876026:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cfa2503f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787707458.876034:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 499 00000100:00080000:3.0:1787707458.876039:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787707458.876045:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cfa2503f800 using connection 192.168.204.146@tcp/0@lo 00000100:00100000:1.0:1787707458.877416:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08773480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a4807cb1-ea3f-4016-a232-153195075fb5:3316:1874546729778432:0@lo:400:kworker.0 00000100:00100000:1.0:1787707458.877491:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707458.877590:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729778432 00000100:00100000:1.0:1787707458.877597:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729778432 00000100:00100000:1.0:1787707458.877639:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787707458.877648:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf9012b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+12:3316:x1874546729778432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707458.877697:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf9012b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+12:3316:x1874546729778432:12345-0@lo:400:kworker.0 Request processed in 49us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707458.877704:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787707458.877749:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08773480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a4807cb1-ea3f-4016-a232-153195075fb5:3316:1874546729778432:0@lo:400:kworker.0 00000100:00100000:3.0:1787707458.877911:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfa08771f80 x1874546729778560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787707458.877936:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787707458.877940:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787707458.877943:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cfa35b35800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787707458.877946:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 499 00000100:00080000:3.0:1787707458.877950:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787707458.877954:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cfa35b35800 using connection 192.168.204.146@tcp/0@lo 00000100:00100000:3.0:1787707458.877968:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfa08772a00 x1874546729778688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787707458.880333:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08771c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729778816:0@lo:400:kworker.0 00000100:00100000:1.0:1787707458.880445:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707458.880535:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729778560:0@lo:8:kworker.0 00000400:00000100:1.0:1787707458.880563:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874546729778560 offset 0 length 520: 4 00000100:00100000:1.0:1787707458.880589:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08772a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729778688:0@lo:8:kworker.0 00000400:00000100:1.0:1787707458.880619:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874546729778688 offset 0 length 520: 4 00000100:00100000:0.0:1787707458.881059:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729778816 00000100:00100000:0.0:1787707458.881078:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729778816 00000100:00100000:0.0:1787707458.881127:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787707458.881137:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729778816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707458.881206:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729778816:12345-0@lo:400:kworker.0 Request processed in 70us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707458.881214:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787707458.881747:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cfa08771c00 x1874546729778816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707458.881762:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08771c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729778816:0@lo:400:kworker.0 00010000:00010000:3.0:1787707459.449129:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787707459.575858:0:14863:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd29f050a0 20000000:00000080:0.0:1787707459.575880:0:14863:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cfa3bdbfc00 uarg=0000000000000000 20000000:01000000:0.0:1787707459.575921:0:14863:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787707459.575928:0:14863:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787707459.575934:0:14863:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787707459.581424:0:14864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1787707459.581678:0:14863:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787707459.593551:0:14863:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787707459.593730:0:14863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfa41a15800/0xc5f18d5f94ec1a24 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707459.593752:0:14863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa3f8dbe00/0xc5f18d5f94ec19e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec19de expref: 11 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707459.593760:0:14863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfa41a15800/0xc5f18d5f94ec1a24 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707459.593928:0:14863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa3f8dbe00/0xc5f18d5f94ec19e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec19de expref: 11 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707459.593947:0:14863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfa3f8dbe00/0xc5f18d5f94ec19e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec19de expref: 11 pid: 14423 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707459.593962:0:14863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f150a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14863:1874546729778944:0@lo:104: 00000100:00100000:1.0:1787707459.594038:0:14863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707459.594147:0:14863:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073bc240 going to sleep for 11 seconds 00000100:00100000:3.0:1787707459.594335:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729778944 00000100:00100000:3.0:1787707459.594344:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729778944 00000100:00100000:3.0:1787707459.594430:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787707459.594441:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f150e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a4807cb1-ea3f-4016-a232-153195075fb5+3:14863:x1874546729778944:12345-0@lo:104: 00010000:00010000:3.0:1787707459.594455:0:14413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec19de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec19e5 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707459.594514:0:14413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787707459.594520:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f150e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a4807cb1-ea3f-4016-a232-153195075fb5+3:14863:x1874546729778944:12345-0@lo:104: Request processed in 82us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707459.594527:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787707459.594679:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787707459.594686:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec19de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec19e5 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707459.594694:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd400 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:2.0:1787707459.594698:0:14418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec19de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec19e5 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707459.594717:0:14418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec19de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec19e5 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787707459.594743:0:14418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec19de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec19e5 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707459.594749:0:14418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787707459.594788:0:14418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec19de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec19e5 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707459.594807:0:14418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787707459.594839:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec19de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec19e5 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707459.594847:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa421fd400/0xc5f18d5f94ec19de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec19e5 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707459.594864:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707459.594866:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707459.594868:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707459.594876:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787707459.594887:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a4807cb1-ea3f-4016-a232-153195075fb5:3315:1874546729779072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787707459.594929:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707459.594966:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729779072 00000100:00100000:2.0:1787707459.594971:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729779072 00010000:00010000:2.0:1787707459.594994:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa3f8dbe00/0xc5f18d5f94ec19e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec19de expref: 12 pid: 14423 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707459.595015:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787707459.595021:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f154380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4807cb1-ea3f-4016-a232-153195075fb5+12:3315:x1874546729779072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787707459.595034:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707459.595046:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa3f8dbe00/0xc5f18d5f94ec19e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec19de expref: 12 pid: 14423 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707459.595058:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa3f8dbe00/0xc5f18d5f94ec19e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec19de expref: 12 pid: 14423 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707459.595076:0:14414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfa41a15800/0xc5f18d5f94ec1a24 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707459.595084:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa41a15800/0xc5f18d5f94ec1a24 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707459.595098:0:14414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa41a15800/0xc5f18d5f94ec1a24 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707459.595106:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa41a15800/0xc5f18d5f94ec1a24 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707459.595112:0:14414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfa41a15800/0xc5f18d5f94ec1a24 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707459.595130:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfa41a15800/0xc5f18d5f94ec1a24 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707459.595135:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15800 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707459.595139:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfa41a15800/0xc5f18d5f94ec1a24 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707459.595146:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfa41a15800/0xc5f18d5f94ec1a24 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707459.595154:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfa41a15800/0xc5f18d5f94ec1a24 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707459.595172:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707459.595201:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f154380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4807cb1-ea3f-4016-a232-153195075fb5+12:3315:x1874546729779072:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707459.595531:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787707459.595572:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a4807cb1-ea3f-4016-a232-153195075fb5:3315:1874546729779072:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787707459.596137:0:14863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa3f8dbe00/0xc5f18d5f94ec19e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec19de expref: 11 pid: 14423 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707459.596162:0:14863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f150a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14863:1874546729778944:0@lo:104: 00010000:00010000:1.0:1787707459.596176:0:14863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfa41a15800/0xc5f18d5f94ec1a24 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707459.596183:0:14863:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfa41a15800/0xc5f18d5f94ec1a24 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707459.596188:0:14863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfa41a15800/0xc5f18d5f94ec1a24 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707459.596193:0:14863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa41a15800/0xc5f18d5f94ec1a24 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707460.481532:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787707460.865119:0:14460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1787707461.305591:0:14426:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787707461.305600:0:14426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfa2a55f000 from 10 10000000:01000000:3.0:1787707461.305604:0:14426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787707461.305672:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec1a2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707461.305692:0:14426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec1a2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707461.305704:0:14426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec1a2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707461.305729:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08770700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729779200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787707461.305805:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707461.305861:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1869d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787707461.306091:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729779200 00000100:00100000:0.0:1787707461.306098:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729779200 00000100:00100000:0.0:1787707461.306152:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787707461.306162:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf9012b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+11:14426:x1874546729779200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787707461.306180:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707461.306192:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa3f8dac00/0xc5f18d5f94ec1a32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec1a2b expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707461.306214:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa3f8dac00/0xc5f18d5f94ec1a32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1a2b expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707461.306224:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa3f8dac00/0xc5f18d5f94ec1a32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1a2b expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707461.306234:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3f8dac00, rc 0) 00000100:00100000:0.0:1787707461.306274:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf9012b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+12:14426:x1874546729779200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707461.306281:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787707461.306324:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08770700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729779200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787707461.306336:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec1a2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1a32 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707461.306345:0:14426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec1a2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec1a32 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707461.306433:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729779328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787707461.306457:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707461.306471:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1fad8540 going to sleep for 11 seconds 00000100:00100000:0.0:1787707461.306482:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729779328 00000100:00100000:0.0:1787707461.306485:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729779328 00000100:00100000:0.0:1787707461.306505:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787707461.306510:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf9012b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+12:14426:x1874546729779328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787707461.306760:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf9012b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+12:14426:x1874546729779328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707461.306766:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787707461.306807:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729779328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787707461.306833:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729779456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787707461.306866:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707461.306877:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1fad8540 going to sleep for 11 seconds 00000100:00100000:0.0:1787707461.306887:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729779456 00000100:00100000:0.0:1787707461.306890:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729779456 00000100:00100000:0.0:1787707461.306908:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787707461.306913:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf9012b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+12:14426:x1874546729779456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787707461.307038:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf9012b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+12:14426:x1874546729779456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707461.307045:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787707461.307077:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729779456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787707461.307806:0:14915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787707461.307860:0:14426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787707461.307876:0:14426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787707461.307886:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec1a2b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1a32 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707461.307896:0:14426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec1a2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1a32 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707461.504484:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707462.521259:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707463.545178:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787707463.992685:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787707463.992693:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787707463.992696:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787707463.992698:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787707463.992850:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787707463.992873:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a4807cb1-ea3f-4016-a232-153195075fb5:3314:1874546729779584:0@lo:400:kworker.0 00000100:00100000:0.0:1787707463.992982:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707463.993590:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729779584 00000100:00100000:2.0:1787707463.993599:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729779584 00000100:00100000:2.0:1787707463.993663:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787707463.993674:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf9012b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+12:3314:x1874546729779584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707463.993750:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf9012b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+12:3314:x1874546729779584:12345-0@lo:400:kworker.0 Request processed in 68us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707463.993758:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787707463.993952:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a4807cb1-ea3f-4016-a232-153195075fb5:3314:1874546729779584:0@lo:400:kworker.0 00000100:00100000:1.0:1787707463.994158:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729779712:0@lo:400:kworker.0 00000100:00100000:1.0:1787707463.994197:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707463.995738:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729779712 00000100:00100000:2.0:1787707463.995759:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729779712 00000100:00100000:2.0:1787707463.995815:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787707463.995825:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729779712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707463.995910:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729779712:12345-0@lo:400:kworker.0 Request processed in 87us (1712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707463.995918:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787707463.996060:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cfa2f154e00 x1874546729779712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707463.996075:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729779712:0@lo:400:kworker.0 00010000:00010000:3.0:1787707464.570437:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707465.598753:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707466.618920:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707467.641595:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707468.665006:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787707468.706088:0:15112:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787707468.706094:0:15112:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787707468.706234:0:15112:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cfa359ee800 00000020:01000004:3.0:1787707468.706255:0:15112:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787707468.706271:0:15112:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787707468.706291:0:15112:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cfa058acd28) 00000020:00000080:3.0:1787707468.706312:0:15112:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787707468.810546:0:15112:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787707468.810836:0:15112:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787707468.819975:0:15112:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787707468.820624:0:15112:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787707468.820908:0:15112:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787707468.821755:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:3.0:1787707468.821875:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:3.0:1787707468.821973:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1787707468.830781:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 280: rc = 0 00100000:10000000:3.0:1787707468.840976:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 280: rc = 0 00100000:10000000:3.0:1787707468.841626:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 280: rc = 0 00100000:10000000:3.0:1787707468.841937:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 280: rc = 0 00100000:10000000:3.0:1787707468.842189:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 280: rc = 0 00100000:10000000:2.0:1787707468.855536:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 280: rc = 0 00000020:00000080:2.0:1787707468.856185:0:15112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787707468.856198:0:15112:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787707468.856209:0:15112:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc5f18d5f94ec1a40 00000020:01000004:2.0:1787707468.856217:0:15112:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787707468.856237:0:15112:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.146@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787707468.856241:0:15112:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787707468.856247:0:15112:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787707468.856251:0:15112:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787707468.856261:0:15112:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cfa073d3370) 00000020:00000080:2.0:1787707468.856271:0:15112:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787707468.857438:0:15112:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787707468.857590:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787707468.857597:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787707468.892613:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787707468.892633:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787707468.903893:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787707468.903910:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787707468.934908:0:15112:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787707468.935113:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787707468.935120:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787707468.959400:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787707468.959416:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787707469.004099:0:15112:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787707469.004569:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787707469.004576:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787707469.008488:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787707469.008507:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787707469.012616:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787707469.012631:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787707469.020988:0:15112:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787707469.022592:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787707469.022604:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787707469.032498:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787707469.032517:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787707469.104264:0:15112:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787707469.104713:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787707469.104720:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787707469.106266:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787707469.106278:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787707469.106981:0:15112:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787707469.107006:0:15112:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787707469.107013:0:15112:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.146@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000100:00080000:0.0:1787707469.112833:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787707469.112839:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787707469.112842:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787707469.113772:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787707469.114325:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a4807cb1-ea3f-4016-a232-153195075fb5:3317:1874546729779840:0@lo:400:kworker.0 00000100:00100000:0.0:1787707469.114413:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707469.114480:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787707469.114488:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729779968:0@lo:400:kworker.0 00000100:00100000:0.0:1787707469.114520:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707469.114552:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729779840 00000100:00100000:0.0:1787707469.114559:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729779840 00000100:00100000:0.0:1787707469.114602:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787707469.114611:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf9012b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+12:3317:x1874546729779840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707469.114676:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf9012b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+12:3317:x1874546729779840:12345-0@lo:400:kworker.0 Request processed in 66us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707469.114685:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787707469.114719:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729779968 00000100:00100000:0.0:1787707469.114723:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729779968 00000100:00100000:0.0:1787707469.119477:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a4807cb1-ea3f-4016-a232-153195075fb5:3317:1874546729779840:0@lo:400:kworker.0 00000100:00100000:0.0:1787707469.119566:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787707469.119578:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729779968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707469.127165:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874546729779968:12345-0@lo:400:kworker.0 Request processed in 7581us (12634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707469.127179:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787707469.127402:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cfa3a57f480 x1874546729779968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707469.127417:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874546729779968:0@lo:400:kworker.0 00000040:01000000:2.0:1787707469.130234:0:15112:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.146@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787707469.130491:0:15112:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.146@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787707469.130496:0:15112:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787707469.130497:0:15112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787707469.130499:0:15112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787707469.130500:0:15112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787707469.130501:0:15112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787707469.130508:0:15112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787707469.130510:0:15112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787707469.130512:0:15112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787707469.130513:0:15112:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787707469.130517:0:15112:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787707469.130519:0:15112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787707469.130520:0:15112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787707469.130521:0:15112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787707469.130522:0:15112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787707469.130523:0:15112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787707469.130524:0:15112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787707469.130525:0:15112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787707469.130525:0:15112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787707469.130526:0:15112:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787707469.130552:0:15112:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787707469.130572:0:15112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f157480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729780096:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787707469.130653:0:15112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707469.130697:0:15112:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0580d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707469.133200:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729780096 00000100:00100000:0.0:1787707469.133221:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729780096 00000100:00100000:0.0:1787707469.133308:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787707469.133323:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+12:15112:x1874546729780096:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787707469.133408:0:14423:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787707469.133413:0:14423:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787707469.133418:0:14423:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787707469.175105:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+12:15112:x1874546729780096:12345-0@lo:253:mount.lustre.0 Request processed in 41773us (44451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707469.175120:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787707469.175201:0:15112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f157480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729780096:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787707469.175217:0:15112:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787707469.175220:0:15112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787707469.175222:0:15112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787707469.175223:0:15112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787707469.175224:0:15112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787707469.175225:0:15112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787707469.175226:0:15112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787707469.175227:0:15112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787707469.175229:0:15112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787707469.175231:0:15112:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787707469.175249:0:15112:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cfa359ee800 from lustre-OST0000 10000000:01000000:2.0:1787707469.175279:0:15112:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787707469.175282:0:15112:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787707469.175289:0:15112:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cfa3add8000 local copy 00010000:00010000:2.0:1787707469.175300:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15e00/0xc5f18d5f94ec1936 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec193d expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707469.176017:0:15112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f157480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729780224:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787707469.176060:0:15112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707469.176134:0:15112:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0580dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787707469.176179:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729780224 00000100:00100000:0.0:1787707469.176186:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729780224 00000100:00100000:0.0:1787707469.176264:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787707469.176273:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+12:15112:x1874546729780224:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787707469.176446:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+12:15112:x1874546729780224:12345-0@lo:501:mount.lustre.0 Request processed in 173us (385us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787707469.176453:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787707469.176515:0:15112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f157480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729780224:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787707469.176586:0:15112:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787707469.183902:0:15112:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787707469.183917:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15e00/0xc5f18d5f94ec1936 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec193d expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707469.184381:0:15112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15e00/0xc5f18d5f94ec1936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec193d expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707469.184413:0:15112:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cfa359ee800 10000000:01000000:2.0:1787707469.184419:0:15112:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787707469.184424:0:15112:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cfa3add8000 10000000:01000000:2.0:1787707469.184427:0:15112:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787707469.184431:0:15112:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8cfa3add8000 from 1 10000000:01000000:2.0:1787707469.184434:0:15112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787707469.184469:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa0871ba00/0xc5f18d5f94ec1a4e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707469.184477:0:15112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa0871ba00/0xc5f18d5f94ec1a4e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707469.184488:0:15112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa0871ba00/0xc5f18d5f94ec1a4e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707469.184511:0:15112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729780352:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787707469.184572:0:15112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707469.184628:0:15112:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0580db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787707469.186609:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729780352 00000100:00100000:0.0:1787707469.186623:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729780352 00000100:00100000:0.0:1787707469.186696:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787707469.186716:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+12:15112:x1874546729780352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787707469.186732:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707469.186749:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa3f8da000/0xc5f18d5f94ec1a55 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec1a4e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.186775:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa3f8da000/0xc5f18d5f94ec1a55 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1a4e expref: 13 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.186785:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa3f8da000/0xc5f18d5f94ec1a55 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1a4e expref: 13 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.186796:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3f8da000, rc 0) 00000100:00100000:0.0:1787707469.186991:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+13:15112:x1874546729780352:12345-0@lo:101:mount.lustre.0 Request processed in 276us (2417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707469.186999:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787707469.187128:0:15112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729780352:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787707469.187146:0:15112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa0871ba00/0xc5f18d5f94ec1a4e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1a55 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707469.187155:0:15112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa0871ba00/0xc5f18d5f94ec1a4e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec1a55 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707469.187173:0:15112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787707469.187189:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa0871ba00/0xc5f18d5f94ec1a4e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1a55 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707469.187198:0:15112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa0871ba00/0xc5f18d5f94ec1a4e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1a55 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707469.187205:0:15112:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787707469.187210:0:15112:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787707469.187215:0:15112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787707469.187217:0:15112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787707469.187235:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa0871ae00/0xc5f18d5f94ec1a5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707469.187242:0:15112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa0871ae00/0xc5f18d5f94ec1a5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707469.187250:0:15112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa0871ae00/0xc5f18d5f94ec1a5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707469.187267:0:15112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729780480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787707469.187298:0:15112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707469.187338:0:15112:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0580db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787707469.188517:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729780480 00000100:00100000:0.0:1787707469.188528:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729780480 00000100:00100000:0.0:1787707469.188569:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787707469.188577:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+13:15112:x1874546729780480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787707469.188589:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707469.188601:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa3f8da200/0xc5f18d5f94ec1a63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec1a5c expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.188621:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa3f8da200/0xc5f18d5f94ec1a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1a5c expref: 14 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.188630:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa3f8da200/0xc5f18d5f94ec1a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1a5c expref: 14 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.188664:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3f8da200, rc 0) 00000100:00100000:0.0:1787707469.188709:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+14:15112:x1874546729780480:12345-0@lo:101:mount.lustre.0 Request processed in 133us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707469.188716:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787707469.189020:0:15112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729780480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787707469.189034:0:15112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa0871ae00/0xc5f18d5f94ec1a5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1a63 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707469.189043:0:15112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa0871ae00/0xc5f18d5f94ec1a5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec1a63 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787707469.189707:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787707469.190624:0:15112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787707469.191265:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787707469.191320:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787707469.191350:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787707469.191409:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787707469.191440:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787707469.191465:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787707469.191521:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787707469.191529:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787707469.191601:0:15112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729780608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787707469.192174:0:15112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707469.192210:0:15112:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0580db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787707469.193264:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729780608 00000100:00100000:0.0:1787707469.193275:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729780608 00000100:00100000:0.0:1787707469.193402:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787707469.193413:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+14:15112:x1874546729780608:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787707469.193835:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+14:15112:x1874546729780608:12345-0@lo:501:mount.lustre.0 Request processed in 423us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707469.193843:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787707469.194616:0:15112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729780608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787707469.194675:0:15112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08770e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729780736:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787707469.194724:0:15112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707469.195212:0:15112:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41fe2600 going to sleep for 11 seconds 00000100:00100000:2.0:1787707469.195257:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729780736 00000100:00100000:2.0:1787707469.195264:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729780736 00000100:00100000:2.0:1787707469.195295:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787707469.195302:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+14:15112:x1874546729780736:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787707469.196218:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+14:15112:x1874546729780736:12345-0@lo:503:mount.lustre.0 Request processed in 914us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707469.196227:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787707469.196546:0:15112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08770e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729780736:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787707469.197179:0:15112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787707469.197262:0:15112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f150700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729780864:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787707469.197314:0:15112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707469.200717:0:15112:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa02f11540 going to sleep for 11 seconds 00000100:00100000:2.0:1787707469.201135:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729780864 00000100:00100000:2.0:1787707469.201157:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729780864 00000100:00100000:2.0:1787707469.201780:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787707469.201792:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+14:15112:x1874546729780864:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787707469.202778:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+14:15112:x1874546729780864:12345-0@lo:502:mount.lustre.0 Request processed in 986us (5461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707469.202788:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787707469.204220:0:15112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f150700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729780864:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787707469.204787:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787707469.204849:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787707469.204881:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787707469.204921:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787707469.204951:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787707469.204976:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787707469.205014:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787707469.205042:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787707469.205068:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787707469.205105:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787707469.205133:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787707469.205182:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787707469.205223:0:15112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f150700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729780992:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787707469.205283:0:15112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707469.205325:0:15112:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa02f11540 going to sleep for 11 seconds 00000100:00100000:2.0:1787707469.205396:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729780992 00000100:00100000:2.0:1787707469.205404:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729780992 00000100:00100000:2.0:1787707469.205487:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787707469.205497:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+14:15112:x1874546729780992:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787707469.205699:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+14:15112:x1874546729780992:12345-0@lo:502:mount.lustre.0 Request processed in 203us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707469.205707:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787707469.205788:0:15112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f150700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729780992:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787707469.205861:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787707469.205872:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1787707469.206741:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787707469.206749:0:15127:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787707469.206756:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707469.206758:0:15127:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787707469.206763:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787707469.206779:0:15127:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cfa073d19b8) 00000020:00000080:2.0:1787707469.206801:0:15127:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787707469.206808:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787707469.206879:0:15127:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfa359ee800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787707469.206887:0:15127:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787707469.206894:0:15127:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc5f18d5f94ec1a71 00010000:00010000:2.0:1787707469.210543:0:15127:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787707469.210969:0:15127:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1787707469.212603:0:15127:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787707469.213959:0:15127:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787707469.213971:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787707469.213984:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707469.213986:0:15127:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787707469.213991:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787707469.213993:0:15127:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787707469.213995:0:15127:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787707469.213997:0:15127:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787707469.213998:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787707469.214001:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707469.214002:0:15127:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787707469.214004:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787707469.214007:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707469.214008:0:15127:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787707469.214011:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787707469.214013:0:15127:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787707469.214015:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787707469.214018:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707469.214019:0:15127:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787707469.214021:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787707469.214023:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707469.214025:0:15127:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787707469.214027:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787707469.214079:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787707469.214083:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707469.214084:0:15127:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787707469.214087:0:15127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787707469.214242:0:15112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787707469.214274:0:15112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787707469.214296:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa0871ae00/0xc5f18d5f94ec1a5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1a63 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707469.214307:0:15112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa0871ae00/0xc5f18d5f94ec1a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1a63 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707469.214315:0:15112:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfa359ee800 from 1 10000000:01000000:1.0:1787707469.214318:0:15112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787707469.214356:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14600/0xc5f18d5f94ec1a78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707469.214363:0:15112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14600/0xc5f18d5f94ec1a78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707469.214416:0:15112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14600/0xc5f18d5f94ec1a78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707469.214439:0:15112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729781120:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787707469.214507:0:15112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707469.214542:0:15112:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa02f11d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787707469.214607:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729781120 00000100:00100000:2.0:1787707469.214615:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729781120 00000100:00100000:2.0:1787707469.214668:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787707469.214679:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+14:15112:x1874546729781120:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787707469.214693:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707469.214705:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa0871aa00/0xc5f18d5f94ec1a7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec1a78 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707469.214729:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa0871aa00/0xc5f18d5f94ec1a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1a78 expref: 15 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707469.214749:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa0871aa00/0xc5f18d5f94ec1a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1a78 expref: 15 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707469.214758:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871aa00, rc 0) 00000100:00100000:2.0:1787707469.214803:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+15:15112:x1874546729781120:12345-0@lo:101:mount.lustre.0 Request processed in 125us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707469.214811:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787707469.214950:0:15112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729781120:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787707469.214965:0:15112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14600/0xc5f18d5f94ec1a78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1a7f expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707469.214975:0:15112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14600/0xc5f18d5f94ec1a78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec1a7f expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787707469.215623:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787707469.215908:0:15112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787707469.216316:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787707469.216633:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787707469.216748:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787707469.216763:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787707469.216845:0:15112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729781248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787707469.216899:0:15112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707469.216980:0:15112:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073973c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787707469.217024:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729781248 00000100:00100000:2.0:1787707469.217032:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729781248 00000100:00100000:2.0:1787707469.217132:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787707469.217143:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+15:15112:x1874546729781248:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787707469.219762:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+15:15112:x1874546729781248:12345-0@lo:501:mount.lustre.0 Request processed in 2612us (2853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707469.219775:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787707469.219914:0:15112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729781248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787707469.219962:0:15112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729781376:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787707469.220021:0:15112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707469.220061:0:15112:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073973c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707469.220539:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729781376 00000100:00100000:1.0:1787707469.220546:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729781376 00000100:00100000:1.0:1787707469.221764:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787707469.221776:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+15:15112:x1874546729781376:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787707469.221990:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+15:15112:x1874546729781376:12345-0@lo:503:mount.lustre.0 Request processed in 217us (1968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707469.221998:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787707469.222078:0:15112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729781376:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787707469.222721:0:15112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787707469.222802:0:15112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729781504:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787707469.222849:0:15112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707469.223401:0:15112:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073973c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787707469.223486:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729781504 00000100:00100000:2.0:1787707469.223493:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729781504 00000100:00100000:2.0:1787707469.223523:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787707469.223530:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+15:15112:x1874546729781504:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787707469.223727:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+15:15112:x1874546729781504:12345-0@lo:502:mount.lustre.0 Request processed in 196us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707469.223734:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787707469.223824:0:15112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729781504:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787707469.224058:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787707469.224101:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787707469.224144:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787707469.224177:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787707469.224206:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787707469.224246:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787707469.224276:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787707469.224304:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787707469.224329:0:15112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729781632:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787707469.224363:0:15112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707469.224546:0:15112:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa073973c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707469.224650:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729781632 00000100:00100000:1.0:1787707469.224656:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729781632 00000100:00100000:1.0:1787707469.224680:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787707469.224687:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+15:15112:x1874546729781632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787707469.224856:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+15:15112:x1874546729781632:12345-0@lo:502:mount.lustre.0 Request processed in 168us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707469.224863:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787707469.224965:0:15112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729781632:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787707469.225036:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787707469.225046:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787707469.225863:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787707469.225871:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707469.225873:0:15131:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787707469.225878:0:15131:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfa359ee800 00000020:00000080:0.0:1787707469.225880:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787707469.225887:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787707469.225889:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707469.225890:0:15131:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787707469.225893:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787707469.225894:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707469.225896:0:15131:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787707469.225899:0:15131:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfa359ee800 00000020:00000080:0.0:1787707469.225906:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787707469.225958:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787707469.225961:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707469.225963:0:15131:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787707469.225965:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787707469.225967:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707469.225969:0:15131:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787707469.225971:0:15131:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfa359ee800 00000020:00000080:0.0:1787707469.225973:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787707469.226004:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787707469.226007:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707469.226009:0:15131:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787707469.226011:0:15131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787707469.227306:0:15112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787707469.227330:0:15112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787707469.230498:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14600/0xc5f18d5f94ec1a78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1a7f expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707469.230514:0:15112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14600/0xc5f18d5f94ec1a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1a7f expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707469.230572:0:15112:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787707469.230575:0:15112:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cfa359ee800 10000000:01000000:1.0:1787707469.230578:0:15112:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cfa359ee800 10000000:01000000:1.0:1787707469.230582:0:15112:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787707469.230587:0:15112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfa359ee800 from 1 10000000:01000000:1.0:1787707469.230590:0:15112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787707469.230627:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14e00/0xc5f18d5f94ec1a86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707469.230636:0:15112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14e00/0xc5f18d5f94ec1a86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707469.230816:0:15112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14e00/0xc5f18d5f94ec1a86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707469.230843:0:15112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729781760:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787707469.230909:0:15112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707469.230955:0:15112:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41fe03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787707469.231036:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729781760 00000100:00100000:2.0:1787707469.231043:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729781760 00000100:00100000:2.0:1787707469.231082:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787707469.231090:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+15:15112:x1874546729781760:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787707469.231102:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707469.231118:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa0871bc00/0xc5f18d5f94ec1a8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec1a86 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707469.231141:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa0871bc00/0xc5f18d5f94ec1a8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1a86 expref: 16 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707469.231152:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa0871bc00/0xc5f18d5f94ec1a8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1a86 expref: 16 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707469.231161:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871bc00, rc 0) 00000100:00100000:2.0:1787707469.231202:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+16:15112:x1874546729781760:12345-0@lo:101:mount.lustre.0 Request processed in 113us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707469.231209:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787707469.231298:0:15112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729781760:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787707469.231311:0:15112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14e00/0xc5f18d5f94ec1a86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1a8d expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707469.231321:0:15112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14e00/0xc5f18d5f94ec1a86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec1a8d expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787707469.231890:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787707469.232149:0:15112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787707469.234613:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787707469.234734:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787707469.234765:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787707469.234826:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787707469.234859:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787707469.234899:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787707469.234929:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787707469.234956:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787707469.234995:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787707469.235025:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787707469.235053:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787707469.243832:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787707469.243889:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787707469.243924:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787707469.243990:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787707469.244028:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787707469.244063:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787707469.244114:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787707469.244151:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787707469.244187:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787707469.244239:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787707469.244277:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787707469.244309:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787707469.244362:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787707469.244430:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787707469.244458:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787707469.244497:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787707469.244550:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787707469.244652:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787707469.244660:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787707469.244766:0:15112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729781888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787707469.244842:0:15112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707469.244890:0:15112:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41fe03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787707469.245273:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729781888 00000100:00100000:3.0:1787707469.245281:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729781888 00000100:00100000:3.0:1787707469.245321:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787707469.245330:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+16:15112:x1874546729781888:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787707469.245588:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+16:15112:x1874546729781888:12345-0@lo:501:mount.lustre.0 Request processed in 258us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707469.245596:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787707469.245734:0:15112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729781888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787707469.245771:0:15112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729782016:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787707469.245812:0:15112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707469.245844:0:15112:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07397d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787707469.245887:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729782016 00000100:00100000:3.0:1787707469.245892:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729782016 00000100:00100000:3.0:1787707469.245925:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787707469.245932:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+16:15112:x1874546729782016:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787707469.246063:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+16:15112:x1874546729782016:12345-0@lo:503:mount.lustre.0 Request processed in 131us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707469.246071:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787707469.246143:0:15112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729782016:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787707469.246651:0:15112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787707469.246709:0:15112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729782144:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787707469.246743:0:15112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707469.246767:0:15112:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07397d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787707469.248852:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729782144 00000100:00100000:1.0:1787707469.248864:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729782144 00000100:00100000:1.0:1787707469.248920:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787707469.248930:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+16:15112:x1874546729782144:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787707469.249156:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+16:15112:x1874546729782144:12345-0@lo:502:mount.lustre.0 Request processed in 228us (2411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707469.249164:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787707469.249405:0:15112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729782144:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787707469.249696:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787707469.249757:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787707469.249785:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787707469.249825:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787707469.249855:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787707469.249906:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787707469.249936:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787707469.249962:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787707469.250000:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787707469.250030:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787707469.250057:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787707469.250095:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787707469.250124:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787707469.250151:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787707469.250190:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787707469.250219:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787707469.250247:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787707469.250299:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787707469.250329:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787707469.250357:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787707469.250424:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787707469.250456:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787707469.250484:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787707469.250530:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787707469.250568:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787707469.250604:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787707469.250689:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787707469.250727:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787707469.250755:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787707469.250795:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787707469.250833:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787707469.250868:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787707469.250903:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787707469.250969:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787707469.251005:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787707469.251052:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787707469.251090:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787707469.251126:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787707469.251187:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787707469.251225:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787707469.251270:0:15112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729782272:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787707469.251341:0:15112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707469.251415:0:15112:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07397d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787707469.251552:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729782272 00000100:00100000:1.0:1787707469.251560:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729782272 00000100:00100000:1.0:1787707469.251605:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787707469.251614:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+16:15112:x1874546729782272:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787707469.251839:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+16:15112:x1874546729782272:12345-0@lo:502:mount.lustre.0 Request processed in 225us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707469.251846:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787707469.253750:0:15112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729782272:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787707469.253896:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787707469.253914:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787707469.258432:0:15136:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787707469.258465:0:15136:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cf9030cb370) 00000020:00000080:1.0:1787707469.258489:0:15136:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787707469.258579:0:15136:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfa359ee800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787707469.258588:0:15136:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfa359ee800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787707469.258591:0:15136:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfa359ee800 3 00010000:00080000:1.0:1787707469.258630:0:15136:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfa141b5000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.146@tcp at head 00010000:00010000:2.0:1787707469.263314:0:15136:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1787707469.263562:0:15136:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787707469.263602:0:15136:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787707469.263615:0:15136:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc5f18d5f94ec1a9b 00000100:00080000:2.0:1787707469.263625:0:15136:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787707469.263632:0:15136:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cfa141b5000 using connection 192.168.204.146@tcp/0@lo 00000100:00100000:2.0:1787707469.263678:0:15136:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfa2f157b80 x1874546729782400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787707469.263707:0:15136:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787707469.263733:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787707469.263739:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787707469.263742:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787707469.263745:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1787707469.263975:0:15136:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787707469.265402:0:15112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787707469.265441:0:15112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787707469.265461:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14e00/0xc5f18d5f94ec1a86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1a8d expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.265473:0:15112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14e00/0xc5f18d5f94ec1a86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1a8d expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787707469.265530:0:15112:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787707469.265532:0:15112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787707469.265534:0:15112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787707469.265535:0:15112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787707469.265537:0:15112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787707469.265538:0:15112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787707469.265540:0:15112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787707469.265542:0:15112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787707469.265543:0:15112:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787707469.265547:0:15112:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787707469.265550:0:15112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787707469.265551:0:15112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787707469.265552:0:15112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787707469.265554:0:15112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787707469.265554:0:15112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787707469.265556:0:15112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787707469.265556:0:15112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787707469.265563:0:15112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787707469.265564:0:15112:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787707469.265590:0:15112:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787707469.265610:0:15112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729782528:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787707469.265690:0:15112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707469.265732:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729782528 00000100:00100000:0.0:1787707469.265741:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729782528 00000100:00100000:0.0:1787707469.265787:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787707469.265797:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+16:15112:x1874546729782528:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787707469.265839:0:14424:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787707469.265855:0:14424:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787707469.266480:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874546729782400:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787707469.266523:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707469.267249:0:15112:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07397d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787707469.269081:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729782400 00000100:00100000:1.0:1787707469.269093:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729782400 00000100:00100000:1.0:1787707469.269211:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787707469.269221:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3313:x1874546729782400:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787707469.269250:0:14430:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:1.0:1787707469.269298:0:14430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc5f18d5f94ec1aa2 00000004:00100000:1.0:1787707469.269315:0:14430:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787707469.269351:0:14430:0:(import.c:65:import_set_state_nolock()) ffff8cfa086ec800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787707469.269462:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874546729782400:12345-0@lo:38:llog_process_th.0 Request processed in 241us (2937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707469.269470:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787707469.269539:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cfa2f157b80 x1874546729782400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787707479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707469.269550:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787707469.269557:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787707469.269565:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787707469.269569:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787707469.269571:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cfa141b5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787707469.269576:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874546729782400:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1787707469.299768:0:14424:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787707469.299811:0:14424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787707469.300553:0:14445:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787707469.300559:0:14445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787707469.300584:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfa421fd000/0xc5f18d5f94ec1aa9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707469.300603:0:14445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa41a14200/0xc5f18d5f94ec1a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1a0f expref: 16 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707469.300612:0:14445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfa421fd000/0xc5f18d5f94ec1aa9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707469.300662:0:14445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa41a14200/0xc5f18d5f94ec1a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec1a0f expref: 16 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707469.300691:0:14445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfa41a14200/0xc5f18d5f94ec1a16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec1a0f expref: 16 pid: 14424 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707469.300707:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08772680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14445:1874546729782656:0@lo:104: 00000100:00100000:3.0:1787707469.300778:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707469.300816:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa30b2f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707469.300884:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729782656 00000100:00100000:0.0:1787707469.300892:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729782656 00000100:00100000:0.0:1787707469.300947:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787707469.300957:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08772d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a4807cb1-ea3f-4016-a232-153195075fb5+3:14445:x1874546729782656:12345-0@lo:104: 00010000:00010000:0.0:1787707469.300970:0:14412:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa421fda00/0xc5f18d5f94ec1a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec1a16 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.301035:0:14412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787707469.301041:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08772d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a4807cb1-ea3f-4016-a232-153195075fb5+3:14445:x1874546729782656:12345-0@lo:104: Request processed in 86us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707469.301048:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787707469.301070:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787707469.301076:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa421fda00/0xc5f18d5f94ec1a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec1a16 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.301084:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fda00 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:0.0:1787707469.301087:0:14418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fda00/0xc5f18d5f94ec1a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec1a16 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.301103:0:14418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa421fda00/0xc5f18d5f94ec1a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec1a16 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787707469.301111:0:14418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fda00/0xc5f18d5f94ec1a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec1a16 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707469.301117:0:14418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787707469.301209:0:14418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa421fda00/0xc5f18d5f94ec1a0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec1a16 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.301217:0:14418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787707469.301237:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fda00/0xc5f18d5f94ec1a0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec1a16 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.301245:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa421fda00/0xc5f18d5f94ec1a0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec1a16 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.301264:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707469.301266:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707469.301268:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707469.301292:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a4807cb1-ea3f-4016-a232-153195075fb5:3315:1874546729782784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787707469.301321:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707469.301361:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729782784 00000100:00100000:0.0:1787707469.301365:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729782784 00010000:00010000:0.0:1787707469.301407:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa41a14200/0xc5f18d5f94ec1a16 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec1a0f expref: 17 pid: 14424 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707469.301428:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787707469.301435:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4807cb1-ea3f-4016-a232-153195075fb5+17:3315:x1874546729782784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787707469.301453:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707469.301459:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa41a14200/0xc5f18d5f94ec1a16 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec1a0f expref: 17 pid: 14424 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.301469:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa41a14200/0xc5f18d5f94ec1a16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec1a0f expref: 17 pid: 14424 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.301485:0:14414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfa421fd000/0xc5f18d5f94ec1aa9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.301493:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa421fd000/0xc5f18d5f94ec1aa9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787707469.301506:0:14414:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015317522s 00010000:00010000:0.0:1787707469.301510:0:14414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa421fd000/0xc5f18d5f94ec1aa9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.301517:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa421fd000/0xc5f18d5f94ec1aa9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.301524:0:14414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfa421fd000/0xc5f18d5f94ec1aa9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.301530:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfa421fd000/0xc5f18d5f94ec1aa9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.301536:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd000 already unused, calling callback (ffffffffc1630230) 00010000:00010000:0.0:1787707469.301540:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfa421fd000/0xc5f18d5f94ec1aa9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.301547:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfa421fd000/0xc5f18d5f94ec1aa9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.301563:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfa421fd000/0xc5f18d5f94ec1aa9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707469.301573:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707469.301604:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4807cb1-ea3f-4016-a232-153195075fb5+17:3315:x1874546729782784:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707469.301611:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787707469.301795:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a4807cb1-ea3f-4016-a232-153195075fb5:3315:1874546729782784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787707469.302015:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa41a14200/0xc5f18d5f94ec1a16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec1a0f expref: 16 pid: 14424 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707469.302026:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08772680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14445:1874546729782656:0@lo:104: 00010000:00010000:2.0:1787707469.302042:0:14445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfa421fd000/0xc5f18d5f94ec1aa9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707469.302050:0:14445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfa421fd000/0xc5f18d5f94ec1aa9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707469.302055:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfa421fd000/0xc5f18d5f94ec1aa9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707469.302060:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa421fd000/0xc5f18d5f94ec1aa9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707469.333612:0:15112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15112:1874546729782528:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787707469.333632:0:15112:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787707469.333636:0:15112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787707469.333648:0:15112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787707469.333650:0:15112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787707469.333651:0:15112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787707469.333653:0:15112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787707469.333654:0:15112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787707469.333656:0:15112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787707469.333657:0:15112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787707469.333659:0:15112:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787707469.333677:0:15112:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787707469.334133:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+15:15112:x1874546729782528:12345-0@lo:253:mount.lustre.0 Request processed in 67730us (67836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707469.334146:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00080000:10000000:2.0:1787707469.337857:0:15112:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787707469.338031:0:15112:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787707469.338190:0:15112:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787707469.338395:0:15112:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787707469.338921:0:15112:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787707469.339162:0:15112:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787707469.347230:0:15112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787707469.547046:0:15112:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787707469.547055:0:15112:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787707469.547124:0:15112:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787707469.547190:0:15112:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.146@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787707469.547204:0:15112:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787707469.547237:0:15112:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787707469.696826:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787707470.074076:0:14460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787707470.392684:0:14426:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787707470.392695:0:14426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfa2a55f000 from 7 10000000:01000000:0.0:1787707470.392701:0:14426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787707470.392754:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db000/0xc5f18d5f94ec1ab0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707470.392767:0:14426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db000/0xc5f18d5f94ec1ab0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707470.392780:0:14426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db000/0xc5f18d5f94ec1ab0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707470.392825:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729782912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787707470.392901:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707470.393522:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa08cc7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787707470.393681:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729782912 00000100:00100000:3.0:1787707470.393689:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729782912 00000100:00100000:3.0:1787707470.393740:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787707470.393750:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+15:14426:x1874546729782912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787707470.393766:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707470.393782:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec1ab7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec1ab0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707470.393890:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec1ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1ab0 expref: 16 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707470.393904:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec1ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1ab0 expref: 16 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707470.393914:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fcc00, rc 0) 00000100:00100000:3.0:1787707470.393976:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+16:14426:x1874546729782912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 226us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707470.393983:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787707470.395851:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729782912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787707470.395898:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db000/0xc5f18d5f94ec1ab0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1ab7 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707470.395910:0:14426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db000/0xc5f18d5f94ec1ab0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec1ab7 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707470.395979:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729783040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787707470.396033:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707470.396201:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729783040 00000100:00100000:3.0:1787707470.396208:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729783040 00000100:00100000:3.0:1787707470.396254:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787707470.396263:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+16:14426:x1874546729783040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787707470.396284:0:14424:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787707470.396298:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787707470.396301:0:14424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787707470.396751:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+16:14426:x1874546729783040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 486us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707470.396759:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787707470.401711:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa08cc7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787707470.401754:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729783040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787707470.401851:0:14426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787707470.401862:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db000/0xc5f18d5f94ec1ab0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1ab7 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707470.401873:0:14426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db000/0xc5f18d5f94ec1ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1ab7 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707470.727558:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707471.746779:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707472.761357:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707473.400451:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787707458/real 1787707458] req@ffff8cfa08771f80 x1874546729778560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787707473 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707473.400482:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfa08771f80 x1874546729778560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787707473 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707473.400491:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787707458/real 1787707458] req@ffff8cfa08772a00 x1874546729778688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787707473 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707473.400502:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfa08772a00 x1874546729778688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787707473 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787707473.400518:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cfa2503f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787707473.400541:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787707473.400545:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729778560:0@lo:8:kworker.0 00000100:00080000:1.0:1787707473.400550:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cfa35b35800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787707473.400555:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787707473.400558:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08772a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729778688:0@lo:8:kworker.0 00000100:00080000:0.0:1787707473.400686:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787707473.400691:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787707473.400694:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cfa2503f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787707473.400698:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 509 00000100:00080000:0.0:1787707473.400703:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787707473.400709:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cfa2503f800 using connection 192.168.204.146@tcp/0@lo 00000100:00100000:0.0:1787707473.400722:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787707473.400732:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a4807cb1-ea3f-4016-a232-153195075fb5:3317:1874546729783168:0@lo:400:kworker.0 00000100:00100000:0.0:1787707473.400798:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707473.400859:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729783168 00000100:00100000:0.0:1787707473.400866:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729783168 00000100:00100000:0.0:1787707473.400909:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787707473.400918:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+16:3317:x1874546729783168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707473.400966:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+16:3317:x1874546729783168:12345-0@lo:400:kworker.0 Request processed in 49us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707473.400973:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787707473.401027:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a4807cb1-ea3f-4016-a232-153195075fb5:3317:1874546729783168:0@lo:400:kworker.0 00000100:00100000:0.0:1787707473.401058:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfa3a57f800 x1874546729783296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787707473.401082:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787707473.401086:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787707473.401087:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cfa35b35800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787707473.401090:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 509 00000100:00080000:0.0:1787707473.401093:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787707473.401096:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cfa35b35800 using connection 192.168.204.146@tcp/0@lo 00000100:00100000:0.0:1787707473.401106:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfa3a57ea00 x1874546729783424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787707473.401131:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729783552:0@lo:400:kworker.0 00000100:00100000:0.0:1787707473.401157:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707473.401189:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729783552 00000100:00100000:0.0:1787707473.401193:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729783552 00000100:00100000:0.0:1787707473.401217:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787707473.401223:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729783552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707473.401262:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874546729783552:12345-0@lo:400:kworker.0 Request processed in 39us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707473.401268:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787707473.401291:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa3a57f100 x1874546729783552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707473.401301:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874546729783552:0@lo:400:kworker.0 00000100:00100000:0.0:1787707473.401337:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729783680:0@lo:400:kworker.0 00000100:00100000:0.0:1787707473.401400:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707473.401552:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729783680 00000100:00100000:1.0:1787707473.401557:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729783680 00000100:00100000:1.0:1787707473.401606:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787707473.401613:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729783680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707473.401650:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729783680:12345-0@lo:400:kworker.0 Request processed in 38us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707473.401657:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787707473.401686:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa3a57f100 x1874546729783680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707473.401701:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729783680:0@lo:400:kworker.0 00000100:00100000:1.0:1787707473.401720:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729783296:0@lo:8:kworker.0 00000100:00100000:1.0:1787707473.401746:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707473.401766:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729783424:0@lo:8:kworker.0 00000100:00100000:1.0:1787707473.401786:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787707473.402033:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707473.402051:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729783296 00000100:00100000:0.0:1787707473.402056:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729783296 00000100:00100000:0.0:1787707473.403682:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729783424 00000100:00100000:0.0:1787707473.403694:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729783424 00000100:00100000:1.0:1787707473.412466:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787707473.412480:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1874546729783296:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787707473.412512:0:15115:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:1.0:1787707473.412541:0:15115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f18d5f94ec1abe 00002000:00100000:1.0:1787707473.412557:0:15115:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cfa08a78000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787707473.412572:0:15115:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787707473.412575:0:15115:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787707473.412904:0:15115:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787707473.412931:0:15115:0:(import.c:65:import_set_state_nolock()) ffff8cfa08a7a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787707473.413026:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874546729783296:12345-0@lo:8:kworker.0 Request processed in 546us (11278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707473.413034:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787707473.413059:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787707473.413064:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1874546729783424:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787707473.413241:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa3a57f800 x1874546729783296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787707493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707473.413252:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787707473.413261:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787707473.413269:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787707473.413274:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787707473.413276:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cfa2503f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787707473.413299:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787707473.413305:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729783296:0@lo:8:kworker.0 00000004:00080000:3.0:1787707473.413331:0:14451:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787707473.413552:0:14451:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 524460181232ns, next at 0ns, rc = 0 00010000:00020000:1.0:1787707473.413948:0:15115:0:(ldlm_lib.c:1201:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000004:00080000:0.0:1787707473.414221:0:14452:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1787707473.414245:0:14452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14452:1874546729783936:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787707473.414293:0:14452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707473.414312:0:14452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f349600 going to sleep for 11 seconds 00000100:00100000:0.0:1787707473.414332:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729783808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787707473.414355:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707473.414426:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729783808 00000100:00100000:0.0:1787707473.414433:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729783808 00000100:00100000:0.0:1787707473.414479:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787707473.414488:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874546729783808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787707473.414512:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707473.414553:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874546729783808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707473.414572:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787707473.414592:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787707473.414614:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa3a57fb80 x1874546729783808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707473.414630:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729783808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787707473.414648:0:15113:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787707473.414654:0:15113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787707473.415440:0:15116:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787707473.415454:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729783936 00000100:00100000:3.0:1787707473.415458:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729783936 00000100:00100000:3.0:1787707473.415526:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1874546729783424:12345-0@lo:8:kworker.0 Request processed in 2459us (13737us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787707473.415533:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787707473.415547:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787707473.415554:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14452:x1874546729783936:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1787707473.436482:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cfa35b35800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787707473.436500:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787707473.436505:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729783424:0@lo:8:kworker.0 00002000:00080000:3.0:1787707473.437166:0:15115:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787707473.437174:0:15115:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787707473.437179:0:15115:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:3.0:1787707473.455318:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.455331:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1ac5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.455347:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.455351:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.455357:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1ac5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.455403:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1ac5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.455415:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1ac5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.455422:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1ac5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.455747:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787707473.460975:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707473.460991:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1ac5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.461005:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd800 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707473.461025:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1ac5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.461036:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1ac5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.461060:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1ac5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.461069:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1ac5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.461103:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.461106:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.461110:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787707473.474362:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.474400:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1acc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.474418:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.474423:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.474429:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.474626:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.474640:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.474657:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1acc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.474683:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787707473.474700:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707473.474707:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1acc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.474715:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc400 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707473.474720:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1acc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.474729:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1acc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.474745:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1acc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.474753:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1acc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.474775:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.474777:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.474779:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787707473.482852:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.482873:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1ad3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.482891:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.482896:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.482902:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1ad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.482917:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1ad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.483073:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1ad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.483084:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1ad3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.483109:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787707473.483126:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707473.483131:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1ad3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.483140:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fca00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707473.483145:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1ad3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.483154:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1ad3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.483179:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1ad3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.483187:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1ad3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.483208:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.483210:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.483213:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787707473.484066:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.484074:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1ada lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.484086:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.484091:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.484096:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1ada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.484108:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1ada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.484118:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1ada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.484125:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1ada lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.484157:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787707473.484168:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707473.484173:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1ada lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.484180:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd200 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707473.484184:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1ada lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.484191:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1ada lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.484203:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1ada lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.484211:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1ada lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.484227:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.484229:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.484230:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787707473.486695:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.486707:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec1ae1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.486724:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.486736:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.486742:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec1ae1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.486756:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec1ae1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.486765:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec1ae1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.486772:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec1ae1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.486909:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787707473.491104:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787707473.491120:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec1ae1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707473.491139:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc800 already unused, calling callback (ffffffffc1630230) 00010000:00010000:0.0:1787707473.491147:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec1ae1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707473.491160:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec1ae1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707473.491190:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec1ae1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707473.491203:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec1ae1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707473.491235:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707473.491238:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707473.491239:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787707473.497712:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.497724:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1ae8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.497740:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.497745:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.497751:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1ae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.497765:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1ae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.497777:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1ae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.497804:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1ae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.497825:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787707473.497839:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707473.497845:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1ae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.497853:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fda00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707473.497858:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1ae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.497868:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1ae8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.497886:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1ae8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.497894:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1ae8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.497913:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.497915:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.497917:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787707473.498524:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.498538:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9c7a96f/0xc5f18d5f94ec1aef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.498548:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.498551:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.498556:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c7a96f/0xc5f18d5f94ec1aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.498578:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9c7a96f/0xc5f18d5f94ec1aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.498586:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9c7a96f/0xc5f18d5f94ec1aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.498592:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c7a96f/0xc5f18d5f94ec1aef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.498607:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787707473.498616:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707473.498620:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9c7a96f/0xc5f18d5f94ec1aef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.498627:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd000 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707473.498631:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9c7a96f/0xc5f18d5f94ec1aef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.498639:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9c7a96f/0xc5f18d5f94ec1aef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.498657:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9c7a96f/0xc5f18d5f94ec1aef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.498664:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9c7a96f/0xc5f18d5f94ec1aef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.498677:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.498679:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.498680:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787707473.499031:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.499037:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1af6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.499045:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.499048:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.499052:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.499062:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.499069:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.499077:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1af6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.499098:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787707473.499105:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707473.499109:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1af6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.499116:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd400 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707473.499119:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1af6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.499127:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1af6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.499138:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1af6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.499161:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1af6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.499174:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.499176:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.499177:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787707473.499781:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.499788:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1afd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.499797:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.499803:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.499808:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.499818:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.499826:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.499833:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1afd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.499846:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787707473.499854:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707473.499857:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1afd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.499863:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc400 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707473.499866:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1afd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.499872:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1afd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.499882:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1afd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.499901:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1afd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.499915:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.499917:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.499918:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787707473.500304:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.500310:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1b04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.500319:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.500322:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.500326:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1b04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.500335:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1b04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.500343:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1b04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.508044:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1b04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.508109:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787707473.513573:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787707473.513587:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1b04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.513601:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd800 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707473.513606:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1b04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.513617:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1b04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.513644:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1b04 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.513664:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1b04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.513693:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707473.513695:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707473.513696:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787707473.517105:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.517124:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1b0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.517140:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.517144:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.517150:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1b0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.517164:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1b0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.517176:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1b0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.517185:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1b0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.517217:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787707473.517419:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787707473.517428:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1b0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.517438:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fda00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707473.517443:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1b0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.517452:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1b0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.517469:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1b0b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.517476:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1b0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.517499:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707473.517502:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707473.517505:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787707473.517777:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.522727:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1b12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.522751:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.522755:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.522763:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1b12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.522779:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1b12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.524120:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1b12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.524132:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1b12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.524160:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787707473.527396:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.527409:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1b19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.527424:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.527428:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.527434:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1b19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.531413:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1b19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.531429:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1b19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.531642:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1b19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.531685:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787707473.532551:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787707473.532569:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1b12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.532581:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd200 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707473.532585:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1b12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.532596:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1b12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.532616:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1b12 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.532624:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1b12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.532648:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707473.532652:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1b19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.532659:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc400 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707473.532662:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1b19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.532686:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1b19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.533567:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1b19 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.533577:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1b19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.533595:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.533597:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.533599:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787707473.536539:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.536553:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1b20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.536577:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.536582:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.536590:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1b20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.536605:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1b20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.536616:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1b20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.536633:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1b20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.536659:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787707473.536677:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707473.536683:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1b20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.536692:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd400 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707473.536697:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1b20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.536708:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1b20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.536724:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1b20 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.536733:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1b20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.536755:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.536758:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.536760:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707473.538473:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787707473.539776:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.539806:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9c7a96f/0xc5f18d5f94ec1b27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.539822:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.539826:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.539832:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c7a96f/0xc5f18d5f94ec1b27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.539845:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9c7a96f/0xc5f18d5f94ec1b27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.539856:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9c7a96f/0xc5f18d5f94ec1b27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.539863:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c7a96f/0xc5f18d5f94ec1b27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.539884:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787707473.540185:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787707473.540194:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9c7a96f/0xc5f18d5f94ec1b27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.540205:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd000 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707473.540210:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9c7a96f/0xc5f18d5f94ec1b27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.540220:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9c7a96f/0xc5f18d5f94ec1b27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.540239:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9c7a96f/0xc5f18d5f94ec1b27 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.540247:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9c7a96f/0xc5f18d5f94ec1b27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.540269:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707473.540271:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707473.540274:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787707473.542668:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.542685:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1b2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.542700:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.542704:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.542711:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1b2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.542724:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1b2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.542748:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1b2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.542755:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1b2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.542776:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787707473.546184:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.546198:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1b35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.546214:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.546218:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.546224:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1b35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.546237:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1b35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.546246:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1b35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.546252:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1b35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.546292:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787707473.546313:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787707473.546319:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1b2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.546326:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fca00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707473.546331:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1b2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.546341:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1b2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.546358:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1b2e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.546366:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2d96fdc/0xc5f18d5f94ec1b2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.546409:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707473.546413:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1b35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.546420:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fda00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707473.546424:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1b35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.546437:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.546457:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1b35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.546468:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1b35 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.546476:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c37343c/0xc5f18d5f94ec1b35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.546491:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.546492:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.546494:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787707473.553221:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1787707473.556423:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.556438:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1b3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.556458:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.556463:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.556469:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1b3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.556484:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1b3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.556494:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1b3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.556511:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1b3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.556535:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787707473.558185:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787707473.558197:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1b3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.558210:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd200 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707473.558223:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1b3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.558235:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1b3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.558257:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1b3c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.558264:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1b3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.558291:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707473.558293:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707473.558295:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787707473.565152:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.565172:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1b43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.565194:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.565200:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.565206:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1b43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.565222:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1b43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.565233:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1b43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.565241:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1b43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.565265:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787707473.565818:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.565826:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1b4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.565842:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.565845:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.565851:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1b4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.565860:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1b4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.565868:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1b4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.565875:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1b4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.565889:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787707473.566294:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.566300:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1b51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.566309:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.566312:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.566316:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1b51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.566324:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1b51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.566343:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1b51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.566350:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1b51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.566358:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787707473.566805:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.566811:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec1b58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.566819:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.566822:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.566826:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec1b58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.566836:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec1b58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.566844:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec1b58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.566850:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec1b58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.566869:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787707473.567266:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.567273:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7219d37/0xc5f18d5f94ec1b5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.567281:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.567285:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.567289:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7219d37/0xc5f18d5f94ec1b5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.567297:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7219d37/0xc5f18d5f94ec1b5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.567306:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7219d37/0xc5f18d5f94ec1b5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.567313:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7219d37/0xc5f18d5f94ec1b5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.567320:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1787707473.567827:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787707473.567836:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1b43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.567845:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd400 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707473.567850:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1b43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.567859:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1b43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.567878:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1b43 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.567893:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050aa7ec1/0xc5f18d5f94ec1b43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.567912:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787707473.567917:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1b4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.567923:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc400 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707473.567927:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1b4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.567935:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1b4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.567945:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1b4a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.567952:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fddf875/0xc5f18d5f94ec1b4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.567965:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787707473.567968:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1b51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.567973:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd800 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707473.567982:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1b51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.567989:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1b51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.568000:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1b51 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.568007:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031ad83f8/0xc5f18d5f94ec1b51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.568019:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787707473.568028:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec1b58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.568035:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc800 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707473.568038:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec1b58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.568046:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec1b58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.568057:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec1b58 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.568064:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f618f267/0xc5f18d5f94ec1b58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707473.568064:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787707473.568088:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707473.568090:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707473.568093:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707473.574639:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707473.574645:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707473.574648:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707473.574726:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7219d37/0xc5f18d5f94ec1b5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707473.574754:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa013fca00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:1.0:1787707473.574759:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7219d37/0xc5f18d5f94ec1b5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707473.574769:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7219d37/0xc5f18d5f94ec1b5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707473.574793:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7219d37/0xc5f18d5f94ec1b5f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707473.574802:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7219d37/0xc5f18d5f94ec1b5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707473.574824:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707473.574826:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707473.574828:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787707473.575192:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.575200:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da92a4d4/0xc5f18d5f94ec1b66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.575212:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.575223:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.575230:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da92a4d4/0xc5f18d5f94ec1b66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.575243:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da92a4d4/0xc5f18d5f94ec1b66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.575251:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da92a4d4/0xc5f18d5f94ec1b66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.575258:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da92a4d4/0xc5f18d5f94ec1b66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.575282:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787707473.575429:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787707473.575436:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da92a4d4/0xc5f18d5f94ec1b66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.575445:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa013fde00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707473.575449:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da92a4d4/0xc5f18d5f94ec1b66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.575457:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da92a4d4/0xc5f18d5f94ec1b66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.575469:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da92a4d4/0xc5f18d5f94ec1b66 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.575477:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da92a4d4/0xc5f18d5f94ec1b66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.575492:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707473.575495:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707473.575497:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787707473.577998:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.578010:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b4e134b/0xc5f18d5f94ec1b6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.578026:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.578030:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.578037:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b4e134b/0xc5f18d5f94ec1b6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.578050:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b4e134b/0xc5f18d5f94ec1b6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.578060:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b4e134b/0xc5f18d5f94ec1b6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.578076:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b4e134b/0xc5f18d5f94ec1b6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.578102:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787707473.578154:0:15300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787707473.578162:0:15300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b4e134b/0xc5f18d5f94ec1b6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.578172:0:15300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa013fc000 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707473.578178:0:15300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b4e134b/0xc5f18d5f94ec1b6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.578187:0:15300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b4e134b/0xc5f18d5f94ec1b6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.578204:0:15300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b4e134b/0xc5f18d5f94ec1b6d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.578212:0:15300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b4e134b/0xc5f18d5f94ec1b6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.578239:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707473.578241:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707473.578244:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787707473.578581:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787707473.578588:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad9ce528/0xc5f18d5f94ec1b74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.578597:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787707473.578601:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707473.578605:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad9ce528/0xc5f18d5f94ec1b74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.578614:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad9ce528/0xc5f18d5f94ec1b74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.578622:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad9ce528/0xc5f18d5f94ec1b74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.578629:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad9ce528/0xc5f18d5f94ec1b74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.578640:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787707473.582918:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787707473.582932:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad9ce528/0xc5f18d5f94ec1b74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707473.582945:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa013fdc00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:1.0:1787707473.582950:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad9ce528/0xc5f18d5f94ec1b74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707473.582960:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad9ce528/0xc5f18d5f94ec1b74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707473.583002:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad9ce528/0xc5f18d5f94ec1b74 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707473.583010:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad9ce528/0xc5f18d5f94ec1b74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707473.583031:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707473.583033:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707473.583035:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787707473.591342:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787707473.591356:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084929416/0xc5f18d5f94ec1b7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.591406:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=524s v=(0 0) 00010000:00010000:2.0:1787707473.591411:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707473.591418:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084929416/0xc5f18d5f94ec1b7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.591447:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084929416/0xc5f18d5f94ec1b7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.591459:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084929416/0xc5f18d5f94ec1b7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.591467:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084929416/0xc5f18d5f94ec1b7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707473.591489:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1787707473.591769:0:15115:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1787707473.591893:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14452:x1874546729783936:12345-0@lo:5:osp-pre-0-0.0 Request processed in 176335us (177596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707473.591907:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787707473.592195:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707473.592204:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084929416/0xc5f18d5f94ec1b7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.592221:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871a600 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707473.592226:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084929416/0xc5f18d5f94ec1b7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.592235:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084929416/0xc5f18d5f94ec1b7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.592253:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084929416/0xc5f18d5f94ec1b7b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.592260:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084929416/0xc5f18d5f94ec1b7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707473.592278:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.592279:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707473.592282:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707473.592354:0:14452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14452:1874546729783936:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787707473.592395:0:14452:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1787707473.592464:0:14452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f150380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14452:1874546729784064:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787707473.592505:0:14452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707473.592758:0:14452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f65780 going to sleep for 11 seconds 00000100:00100000:3.0:1787707473.593838:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729784064 00000100:00100000:3.0:1787707473.593850:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729784064 00000100:00100000:3.0:1787707473.593907:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787707473.593917:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14452:x1874546729784064:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787707473.593963:0:15116:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1787707473.624530:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14452:x1874546729784064:12345-0@lo:5:osp-pre-0-0.0 Request processed in 30596us (32006us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787707473.624547:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787707473.624975:0:14452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f150380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14452:1874546729784064:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787707473.624992:0:14452:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1787707473.784597:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707474.809277:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787707474.882980:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787707474.882999:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1787707475.841640:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707476.863656:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707477.880549:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787707478.194093:0:15484:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg446-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787707478.841738:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729784192:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787707478.844124:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787707478.844129:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787707478.844133:0:38:0:(import.c:65:import_set_state_nolock()) ffff8cfa35b35800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787707478.844141:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 524 00000100:00080000:3.0:1787707478.844146:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787707478.844152:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cfa35b35800 using connection 192.168.204.146@tcp/0@lo 00000100:00100000:3.0:1787707478.844173:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfa08772680 x1874546729784576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787707478.844224:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08772a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a4807cb1-ea3f-4016-a232-153195075fb5:3317:1874546729784320:0@lo:400:kworker.0 00000100:00100000:3.0:1787707478.844286:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707478.844336:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787707478.844353:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729784832:0@lo:400:kworker.0 00000100:00100000:3.0:1787707478.844405:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707478.844436:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729784448:0@lo:400:kworker.0 00000100:00100000:3.0:1787707478.844472:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707478.844497:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787707478.844502:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729784704:0@lo:400:kworker.0 00000100:00100000:3.0:1787707478.844524:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707478.844551:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08772680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729784576:0@lo:8:kworker.0 00000100:00100000:3.0:1787707478.844574:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707478.844602:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729784320 00000100:00100000:3.0:1787707478.844609:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729784320 00000100:00100000:3.0:1787707478.844648:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787707478.844658:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+16:3317:x1874546729784320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707478.844704:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+16:3317:x1874546729784320:12345-0@lo:400:kworker.0 Request processed in 48us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707478.844724:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787707478.844758:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729784832 00000100:00100000:3.0:1787707478.844761:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729784832 00000100:00100000:3.0:1787707478.844808:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729784704 00000100:00100000:3.0:1787707478.844811:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729784704 00000100:00100000:3.0:1787707478.844828:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787707478.844834:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729784832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707478.844867:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729784832:12345-0@lo:400:kworker.0 Request processed in 32us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707478.844873:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787707478.844885:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787707478.844891:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729784704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707478.844920:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729784704:12345-0@lo:400:kworker.0 Request processed in 30us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707478.844940:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787707478.844962:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787707478.844989:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa08770e00 x1874546729784704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707478.845004:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729784704:0@lo:400:kworker.0 00010000:00080000:3.0:1787707478.845180:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa08770700 x1874546729784832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707478.845190:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729784832:0@lo:400:kworker.0 00000100:00100000:3.0:1787707478.845197:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08772a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a4807cb1-ea3f-4016-a232-153195075fb5:3317:1874546729784320:0@lo:400:kworker.0 00000100:00100000:1.0:1787707478.845591:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707478.846014:0:15297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729784448 00000100:00100000:0.0:1787707478.846020:0:15297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729784448 00000100:00100000:0.0:1787707478.846166:0:15297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729784576 00000100:00100000:0.0:1787707478.846170:0:15297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729784576 00000100:00100000:0.0:1787707478.846189:0:15297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787707478.846197:0:15297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08773480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729784448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707478.846251:0:15297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08773480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729784448:12345-0@lo:400:kworker.0 Request processed in 55us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707478.846257:0:15297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787707478.846272:0:15297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787707478.846276:0:15297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3313:x1874546729784576:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787707478.846292:0:15297:0:(ldlm_lib.c:1201:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787707478.852548:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729784192 00000100:00100000:3.0:1787707478.852577:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729784192 00000100:00100000:3.0:1787707478.852639:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787707478.852649:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729784192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787707478.852687:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707478.852764:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729784192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (7174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707478.852771:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787707478.852991:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787707478.853012:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729784192:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787707478.853032:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787707478.853055:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729784448:0@lo:400:kworker.0 00010000:00010000:1.0:1787707478.904639:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707478.906729:0:15297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3313:x1874546729784576:12345-0@lo:8:kworker.0 Request processed in 60443us (62145us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787707478.906746:0:15297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787707478.906946:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cfa35b35800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787707478.906953:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787707478.906957:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08772680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729784576:0@lo:8:kworker.0 00010000:00010000:1.0:1787707479.928515:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787707480.313089:0:14460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787707480.952563:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707481.985532:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707483.000622:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787707483.962055:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787707483.962062:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787707483.962065:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cfa35b35800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787707483.962073:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 529 00000100:00080000:3.0:1787707483.962077:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787707483.962083:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cfa35b35800 using connection 192.168.204.146@tcp/0@lo 00000100:00100000:3.0:1787707483.962105:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfa08770700 x1874546729785216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787707483.962210:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a4807cb1-ea3f-4016-a232-153195075fb5:3317:1874546729784960:0@lo:400:kworker.0 00000100:00100000:1.0:1787707483.963465:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729785216:0@lo:8:kworker.0 00000100:00100000:1.0:1787707483.963536:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707483.963607:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729785216 00000100:00100000:1.0:1787707483.963617:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729785216 00000100:00100000:1.0:1787707483.963656:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787707483.963664:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1874546729785216:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787707483.963683:0:15115:0:(ldlm_lib.c:1201:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787707483.969600:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707483.969661:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729785600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787707483.969689:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707483.969719:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787707483.969727:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08771500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729785472:0@lo:400:kworker.0 00000100:00100000:3.0:1787707483.969752:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707483.969789:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08772a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729785088:0@lo:400:kworker.0 00000100:00100000:3.0:1787707483.969811:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707483.969826:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787707483.969831:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729785344:0@lo:400:kworker.0 00000100:00100000:3.0:1787707483.969846:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707483.969871:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729784960 00000100:00100000:3.0:1787707483.969878:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729784960 00000100:00100000:3.0:1787707483.969926:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787707483.969935:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+16:3317:x1874546729784960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707483.969975:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+16:3317:x1874546729784960:12345-0@lo:400:kworker.0 Request processed in 40us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707483.969983:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787707483.970008:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729785600 00000100:00100000:3.0:1787707483.970011:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729785600 00000100:00100000:3.0:1787707483.970037:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787707483.970042:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729785600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787707483.970069:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707483.970095:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729785600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707483.970100:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787707483.970124:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729785472 00000100:00100000:3.0:1787707483.970127:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729785472 00000100:00100000:3.0:1787707483.970146:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729785344 00000100:00100000:3.0:1787707483.970149:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729785344 00000100:00100000:3.0:1787707483.970160:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787707483.970165:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729785472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707483.970190:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729785472:12345-0@lo:400:kworker.0 Request processed in 25us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707483.970196:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787707483.970206:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787707483.970210:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729785344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707483.971791:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729785344:12345-0@lo:400:kworker.0 Request processed in 21us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707483.971802:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787707483.971839:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729785088 00000100:00100000:3.0:1787707483.971847:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729785088 00000100:00100000:3.0:1787707483.971879:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787707483.971885:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729785088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707483.971940:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729785088:12345-0@lo:400:kworker.0 Request processed in 55us (2128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707483.971946:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787707483.971966:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787707483.971970:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787707483.972004:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa08770e00 x1874546729785344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707483.972020:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729785344:0@lo:400:kworker.0 00000100:00100000:3.0:1787707483.972030:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08772a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729785088:0@lo:400:kworker.0 00010000:00080000:3.0:1787707483.972082:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa08771500 x1874546729785472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707483.972092:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08771500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729785472:0@lo:400:kworker.0 00000100:00100000:3.0:1787707483.972106:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729785600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787707483.972114:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a4807cb1-ea3f-4016-a232-153195075fb5:3317:1874546729784960:0@lo:400:kworker.0 00000100:00100000:1.0:1787707483.995293:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1874546729785216:12345-0@lo:8:kworker.0 Request processed in 31622us (31750us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787707483.995309:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787707483.995473:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cfa35b35800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787707483.995479:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787707483.995483:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729785216:0@lo:8:kworker.0 00010000:00010000:2.0:1787707484.024737:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707485.049101:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707486.073133:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787707486.223947:0:15835:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787707486.223951:0:15835:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787707486.224082:0:15835:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cfa3acd9800 00000020:01000004:2.0:1787707486.224098:0:15835:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787707486.224111:0:15835:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787707486.224125:0:15835:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cfa073d4d28) 00000020:00000080:2.0:1787707486.224142:0:15835:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787707486.239792:0:15835:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787707486.240055:0:15835:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787707486.241122:0:15835:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787707486.241368:0:15835:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787707486.241653:0:15835:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787707486.241989:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 467: rc = 0 00100000:10000000:2.0:1787707486.242084:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 467: rc = 0 00100000:10000000:2.0:1787707486.242184:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 467: rc = 0 00100000:10000000:2.0:1787707486.242896:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 655: rc = 0 00100000:10000000:2.0:1787707486.243157:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 655: rc = 0 00100000:10000000:2.0:1787707486.243547:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 655: rc = 0 00100000:10000000:2.0:1787707486.243811:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 655: rc = 0 00100000:10000000:2.0:1787707486.244047:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 655: rc = 0 00100000:10000000:2.0:1787707486.244288:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 655: rc = 0 00000020:00000080:2.0:1787707486.245038:0:15835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787707486.245053:0:15835:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787707486.245064:0:15835:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc5f18d5f94ec1b89 00000020:01000004:2.0:1787707486.245072:0:15835:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787707486.245094:0:15835:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.146@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787707486.245098:0:15835:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787707486.245103:0:15835:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787707486.245122:0:15835:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787707486.245127:0:15835:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.146@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787707486.262573:0:15835:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.146@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787707486.262623:0:15835:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.146@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787707486.262628:0:15835:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787707486.262630:0:15835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787707486.262631:0:15835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787707486.262633:0:15835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787707486.262634:0:15835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787707486.262635:0:15835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787707486.262637:0:15835:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787707486.262639:0:15835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787707486.262640:0:15835:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787707486.262643:0:15835:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787707486.262646:0:15835:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787707486.262647:0:15835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787707486.262648:0:15835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787707486.262649:0:15835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787707486.262651:0:15835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787707486.262652:0:15835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787707486.262653:0:15835:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787707486.262654:0:15835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787707486.262655:0:15835:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787707486.262681:0:15835:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787707486.262700:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08770700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729785728:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787707486.262781:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707486.262896:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa111869c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707486.262992:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729785728 00000100:00100000:0.0:1787707486.263001:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729785728 00000100:00100000:0.0:1787707486.263080:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787707486.263091:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+16:15835:x1874546729785728:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787707486.263124:0:14424:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787707486.263127:0:14424:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787707486.263131:0:14424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787707486.293028:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+16:15835:x1874546729785728:12345-0@lo:253:mount.lustre.0 Request processed in 29928us (30237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707486.293044:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787707486.293161:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08770700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729785728:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787707486.293179:0:15835:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787707486.293183:0:15835:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787707486.293185:0:15835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787707486.293186:0:15835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787707486.293187:0:15835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787707486.293189:0:15835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787707486.293190:0:15835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787707486.293219:0:15835:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787707486.293222:0:15835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787707486.293224:0:15835:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787707486.293246:0:15835:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cfa3acd9800 from lustre-OST0001 10000000:01000000:1.0:1787707486.293273:0:15835:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787707486.293276:0:15835:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787707486.293284:0:15835:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cfa3add8000 local copy 00010000:00010000:1.0:1787707486.293296:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15e00/0xc5f18d5f94ec1936 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec193d expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707486.293572:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f151f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729785856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787707486.293923:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707486.293968:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05d760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787707486.294294:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729785856 00000100:00100000:2.0:1787707486.294302:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729785856 00000100:00100000:2.0:1787707486.294359:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787707486.294394:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+16:15835:x1874546729785856:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787707486.295156:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+16:15835:x1874546729785856:12345-0@lo:501:mount.lustre.0 Request processed in 786us (1230us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787707486.295167:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787707486.296466:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f151f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729785856:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787707486.296491:0:15835:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787707486.296764:0:15835:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787707486.296774:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15e00/0xc5f18d5f94ec1936 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec193d expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707486.296785:0:15835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15e00/0xc5f18d5f94ec1936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec193d expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707486.296816:0:15835:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cfa3acd9800 10000000:01000000:1.0:1787707486.296821:0:15835:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787707486.296828:0:15835:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787707486.296830:0:15835:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787707486.296835:0:15835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787707486.296838:0:15835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787707486.296870:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15400/0xc5f18d5f94ec1b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707486.296890:0:15835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15400/0xc5f18d5f94ec1b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707486.296902:0:15835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15400/0xc5f18d5f94ec1b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707486.296921:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f151f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729785984:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787707486.296967:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707486.297400:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729785984 00000100:00100000:2.0:1787707486.297407:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729785984 00000100:00100000:1.0:1787707486.297422:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05d760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787707486.297452:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787707486.297461:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+16:15835:x1874546729785984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787707486.297473:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707486.297486:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa0871b200/0xc5f18d5f94ec1b97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec1b90 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707486.297508:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa0871b200/0xc5f18d5f94ec1b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1b90 expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707486.297520:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa0871b200/0xc5f18d5f94ec1b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1b90 expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707486.297529:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871b200, rc 0) 00000100:00100000:2.0:1787707486.297572:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+17:15835:x1874546729785984:12345-0@lo:101:mount.lustre.0 Request processed in 112us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707486.297579:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787707486.297774:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f151f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729785984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787707486.297788:0:15835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15400/0xc5f18d5f94ec1b90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1b97 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707486.297798:0:15835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15400/0xc5f18d5f94ec1b90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec1b97 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787707486.298857:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787707486.300765:0:15835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787707486.301044:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787707486.301088:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787707486.301124:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787707486.301171:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787707486.301208:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787707486.301243:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787707486.301307:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787707486.301331:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787707486.301462:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f151f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729786112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787707486.301524:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707486.301579:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05d76840 going to sleep for 11 seconds 00000100:00100000:2.0:1787707486.303209:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729786112 00000100:00100000:2.0:1787707486.303224:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729786112 00000100:00100000:2.0:1787707486.303297:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787707486.303309:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+17:15835:x1874546729786112:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787707486.305601:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+17:15835:x1874546729786112:12345-0@lo:501:mount.lustre.0 Request processed in 2286us (4068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707486.305626:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787707486.305877:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f151f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729786112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787707486.305932:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f151f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729786240:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787707486.305991:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707486.306028:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05d76840 going to sleep for 11 seconds 00000100:00100000:3.0:1787707486.306159:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729786240 00000100:00100000:3.0:1787707486.306167:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729786240 00000100:00100000:3.0:1787707486.306219:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787707486.306229:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+17:15835:x1874546729786240:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787707486.306617:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+17:15835:x1874546729786240:12345-0@lo:503:mount.lustre.0 Request processed in 388us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707486.306624:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787707486.307154:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f151f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729786240:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787707486.308406:0:15835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787707486.308485:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f151f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729786368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787707486.308548:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707486.308597:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05d76840 going to sleep for 11 seconds 00000100:00100000:2.0:1787707486.308966:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729786368 00000100:00100000:2.0:1787707486.308975:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729786368 00000100:00100000:2.0:1787707486.309027:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787707486.309037:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+17:15835:x1874546729786368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787707486.309296:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+17:15835:x1874546729786368:12345-0@lo:502:mount.lustre.0 Request processed in 260us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707486.309311:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787707486.309550:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f151f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729786368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787707486.310093:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787707486.310150:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787707486.310184:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787707486.311391:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787707486.311441:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787707486.311474:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787707486.311519:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787707486.311552:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787707486.311596:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1787707486.312520:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f151f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729786496:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787707486.312605:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707486.312989:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05d76840 going to sleep for 11 seconds 00000100:00100000:0.0:1787707486.313046:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729786496 00000100:00100000:0.0:1787707486.313055:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729786496 00000100:00100000:0.0:1787707486.313113:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787707486.313128:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+17:15835:x1874546729786496:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787707486.313363:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+17:15835:x1874546729786496:12345-0@lo:502:mount.lustre.0 Request processed in 236us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707486.313409:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787707486.313740:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f151f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729786496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787707486.313982:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1787707486.313998:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1787707486.315521:0:15836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787707486.315533:0:15836:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787707486.315541:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707486.315544:0:15836:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787707486.315550:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787707486.315567:0:15836:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cfa110e0000) 00000020:00000080:2.0:1787707486.315589:0:15836:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787707486.315595:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787707486.315818:0:15836:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfa3acd9800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787707486.315898:0:15836:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787707486.315907:0:15836:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc5f18d5f94ec1ba5 00010000:00010000:2.0:1787707486.322061:0:15836:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1787707486.323187:0:15836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787707486.327012:0:15836:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787707486.329174:0:15836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787707486.329186:0:15836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787707486.329192:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707486.331311:0:15836:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787707486.331334:0:15836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787707486.331341:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707486.331342:0:15836:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787707486.331346:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787707486.331348:0:15836:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787707486.331350:0:15836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787707486.331352:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707486.331353:0:15836:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787707486.331356:0:15836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787707486.331358:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707486.331360:0:15836:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787707486.331363:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787707486.331452:0:15836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787707486.331455:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787707486.331456:0:15836:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787707486.331459:0:15836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787707486.331809:0:15835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787707486.331856:0:15835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787707486.331877:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15400/0xc5f18d5f94ec1b90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1b97 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707486.331889:0:15835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa41a15400/0xc5f18d5f94ec1b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1b97 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707486.331898:0:15835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfa3acd9800 from 1 10000000:01000000:2.0:1787707486.331900:0:15835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787707486.331938:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa0871be00/0xc5f18d5f94ec1bac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707486.331945:0:15835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa0871be00/0xc5f18d5f94ec1bac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707486.331966:0:15835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa0871be00/0xc5f18d5f94ec1bac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707486.331989:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729786624:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787707486.332056:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707486.332103:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0580d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787707486.332225:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729786624 00000100:00100000:1.0:1787707486.332234:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729786624 00000100:00100000:1.0:1787707486.332285:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787707486.332294:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+17:15835:x1874546729786624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787707486.332307:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707486.332331:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa41a14200/0xc5f18d5f94ec1bb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec1bac expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707486.332355:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa41a14200/0xc5f18d5f94ec1bb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1bac expref: 18 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707486.332365:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa41a14200/0xc5f18d5f94ec1bb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1bac expref: 18 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707486.332399:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a14200, rc 0) 00000100:00100000:1.0:1787707486.332437:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+18:15835:x1874546729786624:12345-0@lo:101:mount.lustre.0 Request processed in 143us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707486.332444:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787707486.332598:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729786624:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787707486.332685:0:15835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa0871be00/0xc5f18d5f94ec1bac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1bb3 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707486.332696:0:15835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa0871be00/0xc5f18d5f94ec1bac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec1bb3 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787707486.345399:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787707486.346312:0:15835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787707486.346976:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787707486.347026:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787707486.347090:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787707486.347098:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787707486.347188:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f151f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729786752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787707486.347347:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707486.348231:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729786752 00000100:00100000:2.0:1787707486.348242:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729786752 00000100:00100000:2.0:1787707486.348304:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787707486.348327:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f059c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+18:15835:x1874546729786752:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787707486.349239:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f059c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+18:15835:x1874546729786752:12345-0@lo:501:mount.lustre.0 Request processed in 922us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707486.349248:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787707486.353708:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05d76cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707486.353759:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f151f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729786752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787707486.354285:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f151f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729786880:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787707486.354521:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707486.354751:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05d76cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787707486.356589:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729786880 00000100:00100000:2.0:1787707486.356601:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729786880 00000100:00100000:3.0:1787707486.358668:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787707486.358684:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f05b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+18:15835:x1874546729786880:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787707486.359035:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f05b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+18:15835:x1874546729786880:12345-0@lo:503:mount.lustre.0 Request processed in 353us (4513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707486.359043:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787707486.359137:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f151f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729786880:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787707486.360267:0:15835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787707486.360407:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729787008:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787707486.360480:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707486.363134:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729787008 00000100:00100000:1.0:1787707486.363148:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729787008 00000100:00100000:3.0:1787707486.371386:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787707486.371415:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f05b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+18:15835:x1874546729787008:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787707486.371727:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f05b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+18:15835:x1874546729787008:12345-0@lo:502:mount.lustre.0 Request processed in 326us (11246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707486.371735:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787707486.373088:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0580de40 going to sleep for 11 seconds 00000100:00100000:0.0:1787707486.373131:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729787008:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787707486.373505:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787707486.373566:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787707486.373612:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787707486.373650:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787707486.373684:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787707486.373735:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787707486.373771:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787707486.373806:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787707486.373989:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729787136:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787707486.374059:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707486.374103:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729787136 00000100:00100000:0.0:1787707486.374110:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729787136 00000100:00100000:0.0:1787707486.374157:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787707486.374173:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f059450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+18:15835:x1874546729787136:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787707486.374601:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f059450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+18:15835:x1874546729787136:12345-0@lo:502:mount.lustre.0 Request processed in 428us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707486.374609:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787707486.374657:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1f91f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787707486.374675:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729787136:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787707486.374768:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787707486.374777:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787707486.381208:0:15840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787707486.381225:0:15840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707486.381227:0:15840:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787707486.381235:0:15840:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfa3acd9800 00000020:00000080:2.0:1787707486.381237:0:15840:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787707486.381244:0:15840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787707486.381246:0:15840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707486.381248:0:15840:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787707486.381250:0:15840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787707486.381252:0:15840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707486.381253:0:15840:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787707486.381257:0:15840:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfa3acd9800 00000020:00000080:2.0:1787707486.381258:0:15840:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787707486.381327:0:15840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787707486.382965:0:15840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707486.382971:0:15840:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787707486.382982:0:15840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787707486.382987:0:15840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707486.382989:0:15840:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787707486.382993:0:15840:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfa3acd9800 00000020:00000080:2.0:1787707486.382996:0:15840:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787707486.388398:0:15840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787707486.388412:0:15840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787707486.388415:0:15840:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787707486.388419:0:15840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787707486.389927:0:15835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787707486.391437:0:15835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787707486.391460:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa0871be00/0xc5f18d5f94ec1bac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1bb3 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.391474:0:15835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa0871be00/0xc5f18d5f94ec1bac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1bb3 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707486.391531:0:15835:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787707486.391535:0:15835:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cfa3acd9800 10000000:01000000:0.0:1787707486.391538:0:15835:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cfa3acd9800 10000000:01000000:0.0:1787707486.391543:0:15835:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787707486.391548:0:15835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfa3acd9800 from 1 10000000:01000000:0.0:1787707486.391551:0:15835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787707486.391593:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db600/0xc5f18d5f94ec1bba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.391603:0:15835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db600/0xc5f18d5f94ec1bba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.391614:0:15835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db600/0xc5f18d5f94ec1bba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707486.391647:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729787264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787707486.391714:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707486.391752:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1f942480 going to sleep for 11 seconds 00000100:00100000:0.0:1787707486.391791:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729787264 00000100:00100000:0.0:1787707486.391799:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729787264 00000100:00100000:0.0:1787707486.393647:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787707486.393668:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f059850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+18:15835:x1874546729787264:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787707486.393686:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707486.393706:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa3f8dba00/0xc5f18d5f94ec1bc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec1bba expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.393741:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa3f8dba00/0xc5f18d5f94ec1bc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1bba expref: 19 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.393751:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa3f8dba00/0xc5f18d5f94ec1bc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1bba expref: 19 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.393760:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3f8dba00, rc 0) 00000100:00100000:0.0:1787707486.395049:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f059850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+19:15835:x1874546729787264:12345-0@lo:101:mount.lustre.0 Request processed in 1385us (3329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707486.395058:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787707486.395127:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729787264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787707486.395147:0:15835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db600/0xc5f18d5f94ec1bba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1bc1 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.395157:0:15835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db600/0xc5f18d5f94ec1bba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec1bc1 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787707486.399924:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1787707486.401504:0:15835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787707486.404755:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787707486.404865:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787707486.404923:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787707486.404989:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787707486.405031:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787707486.405081:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787707486.405114:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787707486.405144:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787707486.405188:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787707486.405241:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787707486.405273:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787707486.405332:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787707486.405410:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787707486.405447:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787707486.405521:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787707486.405560:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787707486.405594:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787707486.405641:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787707486.405690:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787707486.405726:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787707486.405774:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787707486.405808:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787707486.405843:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787707486.405892:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787707486.405928:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787707486.405961:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787707486.406009:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787707486.406045:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787707486.406076:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787707486.406132:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1787707486.406166:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1787707486.406195:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1787707486.406224:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1787707486.406266:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1787707486.406330:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1787707486.406416:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1787707486.406453:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1787707486.406542:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1787707486.406550:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1787707486.406666:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729787392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787707486.406734:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707486.406774:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1f942480 going to sleep for 11 seconds 00000100:00100000:1.0:1787707486.408115:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729787392 00000100:00100000:1.0:1787707486.408126:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729787392 00000100:00100000:1.0:1787707486.408184:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787707486.408205:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f059050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+19:15835:x1874546729787392:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787707486.408523:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f059050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+19:15835:x1874546729787392:12345-0@lo:501:mount.lustre.0 Request processed in 330us (1788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707486.408533:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787707486.411888:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729787392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787707486.411954:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729787520:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787707486.412030:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707486.412070:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729787520 00000100:00100000:0.0:1787707486.412076:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729787520 00000100:00100000:0.0:1787707486.412119:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787707486.412128:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f058850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+19:15835:x1874546729787520:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787707486.428691:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1f942480 going to sleep for 11 seconds 00000100:00100000:0.0:1787707486.435355:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f058850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+19:15835:x1874546729787520:12345-0@lo:503:mount.lustre.0 Request processed in 23218us (23316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707486.435370:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787707486.437813:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729787520:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787707486.438813:0:15835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787707486.443062:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08771f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729787648:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787707486.443151:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707486.443245:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa111869c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707486.449927:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729787648 00000100:00100000:0.0:1787707486.449943:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729787648 00000100:00100000:0.0:1787707486.450062:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787707486.450074:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f05a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+19:15835:x1874546729787648:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787707486.450512:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f05a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+19:15835:x1874546729787648:12345-0@lo:502:mount.lustre.0 Request processed in 439us (7360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707486.450520:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787707486.450638:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08771f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729787648:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787707486.450926:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787707486.450986:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787707486.451022:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787707486.451090:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787707486.451130:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787707486.451183:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787707486.451217:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787707486.451251:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787707486.451299:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787707486.451346:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787707486.451404:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787707486.451450:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787707486.451483:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787707486.451516:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787707486.451566:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787707486.451603:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787707486.451638:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787707486.451687:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787707486.451724:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787707486.451775:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787707486.451841:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787707486.451876:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787707486.451902:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787707486.451939:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787707486.451968:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787707486.451993:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787707486.452027:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787707486.452056:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787707486.452087:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787707486.452132:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787707486.452171:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787707486.452203:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787707486.452248:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787707486.452297:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787707486.452349:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787707486.452446:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787707486.452485:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787707486.452521:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787707486.452570:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787707486.452609:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787707486.452658:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08771f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729787776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787707486.452729:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707486.470135:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa111869c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707486.480010:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729787776 00000100:00100000:1.0:1787707486.480028:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729787776 00000100:00100000:1.0:1787707486.480094:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787707486.480106:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+19:15835:x1874546729787776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787707486.480531:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+19:15835:x1874546729787776:12345-0@lo:502:mount.lustre.0 Request processed in 425us (27800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707486.480539:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787707486.480699:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08771f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729787776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787707486.480812:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787707486.480837:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787707486.483028:0:15845:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787707486.483046:0:15845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cfa058a8000) 00000020:00000080:3.0:1787707486.483069:0:15845:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1787707486.483166:0:15845:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfa3acd9800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787707486.483170:0:15845:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfa3acd9800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787707486.483172:0:15845:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfa3acd9800 3 00010000:00080000:3.0:1787707486.483213:0:15845:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf901dc9800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.146@tcp at head 00010000:00010000:2.0:1787707486.491837:0:15845:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1787707486.492048:0:15845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787707486.492088:0:15845:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787707486.492101:0:15845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc5f18d5f94ec1bcf 00000100:00080000:2.0:1787707486.492110:0:15845:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787707486.492116:0:15845:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cf901dc9800 using connection 192.168.204.146@tcp/0@lo 00000100:00100000:2.0:1787707486.492155:0:15845:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfa2f157480 x1874546729787904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787707486.492179:0:15845:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787707486.494054:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787707486.494061:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787707486.494064:0:38:0:(import.c:65:import_set_state_nolock()) ffff8cfa35b35800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787707486.494073:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 535 00000100:00080000:1.0:1787707486.494076:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787707486.494083:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cfa35b35800 using connection 192.168.204.146@tcp/0@lo 00000100:00100000:1.0:1787707486.494105:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfa2f151c00 x1874546729788160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787707486.494271:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874546729787904:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787707486.494362:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707486.494429:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729788160:0@lo:8:kworker.0 00000100:00100000:3.0:1787707486.494470:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707486.494506:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729788032:0@lo:400:kworker.0 00000100:00100000:3.0:1787707486.494530:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707486.494548:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787707486.494560:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729788288:0@lo:400:kworker.0 00000100:00100000:3.0:1787707486.494583:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707486.494609:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729788416:0@lo:400:kworker.0 00000100:00100000:3.0:1787707486.494633:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707486.494675:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729788160 00000100:00100000:3.0:1787707486.494682:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729788160 00000100:00100000:3.0:1787707486.494717:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729788032 00000100:00100000:3.0:1787707486.494720:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729788032 00000100:00100000:3.0:1787707486.494764:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787707486.494773:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08772a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729788032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707486.494980:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729787904 00000100:00100000:1.0:1787707486.494985:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729787904 00000100:00100000:1.0:1787707486.495000:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729788288 00000100:00100000:1.0:1787707486.495002:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729788288 00000100:00100000:1.0:1787707486.495016:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729788416 00000100:00100000:1.0:1787707486.495019:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729788416 00000100:00100000:1.0:1787707486.495033:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787707486.495040:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729788288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707486.495808:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08772a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729788032:12345-0@lo:400:kworker.0 Request processed in 1033us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707486.495818:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787707486.495852:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787707486.495857:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3313:x1874546729788160:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787707486.495922:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3313:x1874546729788160:12345-0@lo:8:kworker.0 Request processed in 63us (1451us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787707486.495929:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787707486.495953:0:14431:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787707486.495961:0:14431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787707486.495979:0:14429:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787707486.495986:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787707486.495994:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729788416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707486.496029:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729788416:12345-0@lo:400:kworker.0 Request processed in 37us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707486.496036:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787707486.496050:0:14429:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787707486.496056:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787707486.496067:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874546729787904:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787707486.496082:0:14429:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:3.0:1787707486.496124:0:14429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc5f18d5f94ec1bd6 00000004:00100000:3.0:1787707486.496140:0:14429:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787707486.496166:0:14429:0:(import.c:65:import_set_state_nolock()) ffff8cf901dce000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787707486.496198:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874546729787904:12345-0@lo:38:llog_process_th.0 Request processed in 131us (1837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707486.496204:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787707486.496226:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787707486.496231:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787707486.496332:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa2f151f80 x1874546729788416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707486.496348:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729788416:0@lo:400:kworker.0 00010000:00080000:0.0:1787707486.496611:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa2f157480 x1874546729787904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787707496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707486.496621:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787707486.496627:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787707486.496634:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787707486.496639:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787707486.496641:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cf901dc9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787707486.496647:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874546729787904:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787707486.496660:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787707486.496663:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cfa35b35800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787707486.496666:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787707486.496669:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729788160:0@lo:8:kworker.0 00000040:00080000:2.0:1787707486.496950:0:15845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:1.0:1787707486.501109:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729788288:12345-0@lo:400:kworker.0 Request processed in 6060us (6515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707486.501126:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000000:1.0:1787707486.501258:0:15835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787707486.501327:0:15835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787707486.501353:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db600/0xc5f18d5f94ec1bba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1bc1 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707486.501365:0:15835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db600/0xc5f18d5f94ec1bba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1bc1 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787707486.501452:0:15835:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787707486.501455:0:15835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787707486.501456:0:15835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787707486.501457:0:15835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787707486.501459:0:15835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787707486.501460:0:15835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787707486.501461:0:15835:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787707486.501464:0:15835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787707486.501465:0:15835:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787707486.501469:0:15835:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787707486.501471:0:15835:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787707486.501473:0:15835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787707486.501478:0:15835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787707486.501479:0:15835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787707486.501480:0:15835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787707486.501481:0:15835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787707486.501482:0:15835:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787707486.501482:0:15835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787707486.501483:0:15835:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787707486.501513:0:15835:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787707486.501535:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f151880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729788544:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787707486.501610:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707486.501647:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729788544 00000100:00100000:1.0:1787707486.501655:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729788544 00000100:00100000:1.0:1787707486.501698:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787707486.501705:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+19:15835:x1874546729788544:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787707486.501730:0:14422:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787707486.501743:0:14422:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1787707486.502025:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfa2f153b80 x1874546729788288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707486.502042:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729788288:0@lo:400:kworker.0 00000100:00100000:3.0:1787707486.502059:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729788032:0@lo:400:kworker.0 00000100:00100000:0.0:1787707486.504429:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa05d760c0 going to sleep for 11 seconds 20000000:01000000:2.0:1787707486.543773:0:14422:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787707486.543791:0:14422:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787707486.543835:0:14445:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787707486.543841:0:14445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787707486.543866:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfa3f8db400/0xc5f18d5f94ec1bdd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.543886:0:14445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec1ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1ab0 expref: 19 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.543895:0:14445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfa3f8db400/0xc5f18d5f94ec1bdd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.543957:0:14445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec1ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec1ab0 expref: 19 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.543972:0:14445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec1ab7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec1ab0 expref: 19 pid: 14422 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707486.543987:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14445:1874546729788672:0@lo:104: 00000100:00100000:0.0:1787707486.544058:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707486.544717:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729788672 00000100:00100000:1.0:1787707486.544727:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729788672 00000100:00100000:0.0:1787707486.544748:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1869df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787707486.544805:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787707486.544815:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a4807cb1-ea3f-4016-a232-153195075fb5+3:14445:x1874546729788672:12345-0@lo:104: 00010000:00010000:1.0:1787707486.544830:0:14413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db000/0xc5f18d5f94ec1ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec1ab7 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707486.544913:0:14413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787707486.544920:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a4807cb1-ea3f-4016-a232-153195075fb5+3:14445:x1874546729788672:12345-0@lo:104: Request processed in 106us (862us total) trans 0 rc 0/0 00010000:00010000:0.0:1787707486.544927:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787707486.544935:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db000/0xc5f18d5f94ec1ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec1ab7 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.544943:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3f8db000 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:0.0:1787707486.544947:0:14418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db000/0xc5f18d5f94ec1ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec1ab7 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.544956:0:14418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db000/0xc5f18d5f94ec1ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec1ab7 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787707486.544963:0:14418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db000/0xc5f18d5f94ec1ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec1ab7 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787707486.544970:0:14418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787707486.545004:0:14418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db000/0xc5f18d5f94ec1ab0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec1ab7 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.545011:0:14418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787707486.545030:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db000/0xc5f18d5f94ec1ab0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec1ab7 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.545047:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8db000/0xc5f18d5f94ec1ab0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec1ab7 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.545063:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707486.545066:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707486.545068:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707486.545074:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787707486.545134:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14445:1874546729788672:0@lo:104: 00010000:00010000:2.0:1787707486.545155:0:14445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfa3f8db400/0xc5f18d5f94ec1bdd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707486.545184:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a4807cb1-ea3f-4016-a232-153195075fb5:3317:1874546729788800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787707486.545217:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707486.545273:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729788800 00000100:00100000:0.0:1787707486.545279:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729788800 00010000:00010000:0.0:1787707486.545299:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec1ab7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec1ab0 expref: 20 pid: 14422 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707486.545407:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787707486.545415:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08773100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4807cb1-ea3f-4016-a232-153195075fb5+20:3317:x1874546729788800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787707486.545428:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707486.545433:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec1ab7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec1ab0 expref: 20 pid: 14422 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.545444:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec1ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec1ab0 expref: 20 pid: 14422 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.545459:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa421fcc00/0xc5f18d5f94ec1ab7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec1ab0 expref: 20 pid: 14422 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.545475:0:14414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfa3f8db400/0xc5f18d5f94ec1bdd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.545483:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa3f8db400/0xc5f18d5f94ec1bdd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787707486.545593:0:14414:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015317522s 00010000:00010000:0.0:1787707486.545597:0:14414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa3f8db400/0xc5f18d5f94ec1bdd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.545604:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa3f8db400/0xc5f18d5f94ec1bdd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.545610:0:14414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfa3f8db400/0xc5f18d5f94ec1bdd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.545615:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfa3f8db400/0xc5f18d5f94ec1bdd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.545619:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3f8db400 already unused, calling callback (ffffffffc1630230) 00010000:00010000:0.0:1787707486.545623:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfa3f8db400/0xc5f18d5f94ec1bdd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.545629:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfa3f8db400/0xc5f18d5f94ec1bdd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.545643:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfa3f8db400/0xc5f18d5f94ec1bdd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707486.545651:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707486.545694:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08773100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4807cb1-ea3f-4016-a232-153195075fb5+19:3317:x1874546729788800:12345-0@lo:103:ldlm_bl.0 Request processed in 280us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707486.545701:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787707486.546743:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a4807cb1-ea3f-4016-a232-153195075fb5:3317:1874546729788800:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787707486.547355:0:14445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfa3f8db400/0xc5f18d5f94ec1bdd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707486.547366:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfa3f8db400/0xc5f18d5f94ec1bdd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707486.547405:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa3f8db400/0xc5f18d5f94ec1bdd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707486.560199:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+18:15835:x1874546729788544:12345-0@lo:253:mount.lustre.0 Request processed in 58472us (58567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707486.560216:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787707486.560401:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f151880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a4807cb1-ea3f-4016-a232-153195075fb5:15835:1874546729788544:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787707486.560419:0:15835:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787707486.560454:0:15835:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787707486.560456:0:15835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787707486.560457:0:15835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787707486.560459:0:15835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787707486.560460:0:15835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787707486.560461:0:15835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787707486.560463:0:15835:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787707486.560464:0:15835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787707486.560466:0:15835:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787707486.560484:0:15835:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787707486.567044:0:15835:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787707486.567194:0:15835:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787707486.567553:0:15835:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787707486.567693:0:15835:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787707486.567816:0:15835:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787707486.568067:0:15835:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787707486.572553:0:15835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787707486.646843:0:15835:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787707486.647027:0:15835:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787707486.647067:0:15835:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787707486.647124:0:15835:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.146@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787707486.647137:0:15835:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787707486.647165:0:15835:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787707487.096927:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787707487.803431:0:14426:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787707487.803440:0:14426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfa2a55f000 from 8 10000000:01000000:0.0:1787707487.803445:0:14426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787707487.803498:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8dae00/0xc5f18d5f94ec1be4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707487.803510:0:14426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8dae00/0xc5f18d5f94ec1be4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707487.803521:0:14426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8dae00/0xc5f18d5f94ec1be4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707487.803548:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729788928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787707487.803636:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707487.803686:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1869de40 going to sleep for 11 seconds 00000100:00100000:2.0:1787707487.803817:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729788928 00000100:00100000:2.0:1787707487.803825:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729788928 00000100:00100000:2.0:1787707487.803886:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787707487.803896:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+18:14426:x1874546729788928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787707487.803909:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707487.803922:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa0871a200/0xc5f18d5f94ec1beb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec1be4 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707487.803961:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa0871a200/0xc5f18d5f94ec1beb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1be4 expref: 19 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707487.803973:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa0871a200/0xc5f18d5f94ec1beb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1be4 expref: 19 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707487.803984:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871a200, rc 0) 00000100:00100000:2.0:1787707487.804030:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+19:14426:x1874546729788928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707487.804038:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787707487.804207:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729788928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787707487.804234:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8dae00/0xc5f18d5f94ec1be4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1beb expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707487.804243:0:14426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8dae00/0xc5f18d5f94ec1be4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec1beb expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707487.804305:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f150380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729789056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787707487.804337:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707487.804355:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0580dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787707487.804495:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729789056 00000100:00100000:0.0:1787707487.804500:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729789056 00000100:00100000:0.0:1787707487.804533:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787707487.804546:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+19:14426:x1874546729789056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787707487.804562:0:14424:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787707487.804576:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787707487.804579:0:14424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787707487.804666:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+19:14426:x1874546729789056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707487.804674:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787707487.804702:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f150380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729789056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787707487.804754:0:14426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787707487.804761:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8dae00/0xc5f18d5f94ec1be4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1beb expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707487.804770:0:14426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa3f8dae00/0xc5f18d5f94ec1be4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1beb expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707488.126125:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707489.080764:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729789184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787707489.080845:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707489.081109:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729789184 00000100:00100000:2.0:1787707489.081118:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729789184 00000100:00100000:2.0:1787707489.081188:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787707489.081197:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08770700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729789184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787707489.081233:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707489.081291:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08770700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729789184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707489.081299:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787707489.081361:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787707489.081415:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729789184:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787707489.147981:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707490.169432:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787707490.553057:0:14460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787707491.192541:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787707491.644499:0:1375:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787707491.644506:0:1375:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787707491.644510:0:1375:0:(import.c:65:import_set_state_nolock()) ffff8cfa35b35800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787707491.644523:0:1375:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cfa35b35800 using connection 192.168.204.146@tcp/0@lo 00000100:00100000:3.0:1787707491.644544:0:1375:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfa3ac51500 x1874546729789568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787707491.644595:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729789824:0@lo:400:kworker.0 00000100:00100000:3.0:1787707491.644663:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707491.644714:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787707491.644720:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08772680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a4807cb1-ea3f-4016-a232-153195075fb5:3314:1874546729789312:0@lo:400:kworker.0 00000100:00100000:3.0:1787707491.644745:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707491.644765:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729789952:0@lo:400:kworker.0 00000100:00100000:3.0:1787707491.644785:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707491.644808:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729789440:0@lo:400:kworker.0 00000100:00100000:3.0:1787707491.644833:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707491.644850:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787707491.644855:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729789696:0@lo:400:kworker.0 00000100:00100000:3.0:1787707491.644875:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707491.644912:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729789568:0@lo:8:kworker.0 00000100:00100000:3.0:1787707491.644935:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707491.644968:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729789824 00000100:00100000:3.0:1787707491.644976:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729789824 00000100:00100000:3.0:1787707491.645033:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729789952 00000100:00100000:3.0:1787707491.645036:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729789952 00000100:00100000:3.0:1787707491.645067:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729789696 00000100:00100000:3.0:1787707491.645070:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729789696 00000100:00100000:3.0:1787707491.645087:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787707491.645105:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729789824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707491.645152:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729789824:12345-0@lo:400:kworker.0 Request processed in 58us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707491.645158:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787707491.645174:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787707491.645180:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729789952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707491.645202:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874546729789952:12345-0@lo:400:kworker.0 Request processed in 23us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707491.645207:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787707491.645365:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787707491.645399:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729789696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707491.645429:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729789696:12345-0@lo:400:kworker.0 Request processed in 32us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707491.645434:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787707491.645451:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729789312 00000100:00100000:3.0:1787707491.645454:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729789312 00000100:00100000:3.0:1787707491.645475:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787707491.645480:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+19:3314:x1874546729789312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707491.645507:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+19:3314:x1874546729789312:12345-0@lo:400:kworker.0 Request processed in 26us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707491.645513:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787707491.645540:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729789440 00000100:00100000:3.0:1787707491.645544:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729789440 00000100:00100000:3.0:1787707491.645568:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729789568 00000100:00100000:3.0:1787707491.645578:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729789568 00000100:00100000:3.0:1787707491.645595:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787707491.645602:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729789440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707491.645636:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729789440:12345-0@lo:400:kworker.0 Request processed in 35us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707491.645643:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787707491.645654:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787707491.645658:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3313:x1874546729789568:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787707491.645681:0:15116:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:3.0:1787707491.645707:0:15116:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f18d5f94ec1bf2 00002000:00100000:3.0:1787707491.645722:0:15116:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cf901dcd000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787707491.645726:0:15116:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787707491.645729:0:15116:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787707491.649161:0:15116:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787707491.649196:0:15116:0:(import.c:65:import_set_state_nolock()) ffff8cf901dcb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787707491.649305:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874546729789568:12345-0@lo:8:kworker.0 Request processed in 3643us (4367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707491.649315:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787707491.649357:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787707491.649363:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787707491.649422:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3ac50380 x1874546729789696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787707491.649439:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729789696:0@lo:400:kworker.0 00000100:00100000:3.0:1787707491.649453:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729789440:0@lo:400:kworker.0 00000100:00100000:3.0:1787707491.649488:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08772680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a4807cb1-ea3f-4016-a232-153195075fb5:3314:1874546729789312:0@lo:400:kworker.0 00010000:00080000:3.0:1787707491.649521:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3ac52d80 x1874546729789952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787707491.650052:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3ac51500 x1874546729789568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787707516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787707491.650074:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787707491.650084:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787707491.650101:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787707491.650104:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8cfa35b35800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787707491.650125:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787707491.650131:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874546729789568:0@lo:8:kworker.0 00000004:00080000:1.0:1787707491.650262:0:14453:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787707491.650747:0:14453:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 542697376004ns, next at 0ns, rc = 0 00000004:00080000:0.0:1787707491.651176:0:14454:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1787707491.651200:0:14454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14454:1874546729790208:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787707491.651268:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707491.651295:0:14454:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1869de40 going to sleep for 11 seconds 00000100:00100000:0.0:1787707491.651308:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787707491.651317:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729790080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787707491.651343:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707491.651388:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729790080 00000100:00100000:0.0:1787707491.651394:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729790080 00000100:00100000:0.0:1787707491.651447:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787707491.651456:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874546729790080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787707491.651505:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707491.651554:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874546729790080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707491.651561:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787707491.651596:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3a57c380 x1874546729790080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787707507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787707491.651611:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729790080:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787707491.651627:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787707491.651706:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729790208 00000100:00100000:0.0:1787707491.651710:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729790208 00000100:00100000:0.0:1787707491.651739:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787707491.651746:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14454:x1874546729790208:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787707491.654801:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874546729789952:0@lo:400:kworker.0 00010000:00080000:2.0:1787707491.661293:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa3ac51880 x1874546729789824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787707491.661311:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729789824:0@lo:400:kworker.0 00002000:00080000:0.0:1787707491.671934:0:15115:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787707491.671947:0:15115:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1787707491.671953:0:15115:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1787707491.712544:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787707491.712559:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001e7e619/0xc5f18d5f94ec1bf9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.712578:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1787707491.712584:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707491.712591:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001e7e619/0xc5f18d5f94ec1bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.712609:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001e7e619/0xc5f18d5f94ec1bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.712632:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001e7e619/0xc5f18d5f94ec1bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.712641:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001e7e619/0xc5f18d5f94ec1bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.712662:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787707491.712677:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787707491.712682:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001e7e619/0xc5f18d5f94ec1bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.712691:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3f8da800 already unused, calling callback (ffffffffc1630230) 00010000:00010000:0.0:1787707491.712696:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001e7e619/0xc5f18d5f94ec1bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.712705:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001e7e619/0xc5f18d5f94ec1bf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.712949:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001e7e619/0xc5f18d5f94ec1bf9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.712959:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001e7e619/0xc5f18d5f94ec1bf9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.712978:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707491.712985:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707491.712987:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787707491.713968:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787707491.713976:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c68977c3/0xc5f18d5f94ec1c00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.713987:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1787707491.713990:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707491.713994:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c68977c3/0xc5f18d5f94ec1c00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.714004:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c68977c3/0xc5f18d5f94ec1c00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.714012:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c68977c3/0xc5f18d5f94ec1c00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.714018:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c68977c3/0xc5f18d5f94ec1c00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.714033:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787707491.714042:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787707491.714046:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c68977c3/0xc5f18d5f94ec1c00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.714052:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3f8da600 already unused, calling callback (ffffffffc1630230) 00010000:00010000:0.0:1787707491.714056:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c68977c3/0xc5f18d5f94ec1c00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.714074:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c68977c3/0xc5f18d5f94ec1c00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.714087:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c68977c3/0xc5f18d5f94ec1c00 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.714094:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c68977c3/0xc5f18d5f94ec1c00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.714106:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707491.714107:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707491.714109:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787707491.715719:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787707491.715730:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000967eabb6/0xc5f18d5f94ec1c07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.715744:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1787707491.715748:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707491.715753:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000967eabb6/0xc5f18d5f94ec1c07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.715764:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000967eabb6/0xc5f18d5f94ec1c07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.715773:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000967eabb6/0xc5f18d5f94ec1c07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.715787:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000967eabb6/0xc5f18d5f94ec1c07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.715876:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787707491.716302:0:15300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707491.716311:0:15300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000967eabb6/0xc5f18d5f94ec1c07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.716323:0:15300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3f8da400 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707491.716328:0:15300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000967eabb6/0xc5f18d5f94ec1c07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.716340:0:15300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000967eabb6/0xc5f18d5f94ec1c07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.716363:0:15300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000967eabb6/0xc5f18d5f94ec1c07 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.716389:0:15300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000967eabb6/0xc5f18d5f94ec1c07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.716420:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707491.716423:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707491.716425:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787707491.716609:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787707491.716616:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047f4e058/0xc5f18d5f94ec1c0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.716627:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1787707491.716630:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707491.716635:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047f4e058/0xc5f18d5f94ec1c0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.716644:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047f4e058/0xc5f18d5f94ec1c0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.716652:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047f4e058/0xc5f18d5f94ec1c0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.716659:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047f4e058/0xc5f18d5f94ec1c0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.716671:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787707491.716679:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787707491.716683:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047f4e058/0xc5f18d5f94ec1c0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.716696:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3f8db000 already unused, calling callback (ffffffffc1630230) 00010000:00010000:0.0:1787707491.716699:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047f4e058/0xc5f18d5f94ec1c0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.716706:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047f4e058/0xc5f18d5f94ec1c0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.716716:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047f4e058/0xc5f18d5f94ec1c0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.716722:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047f4e058/0xc5f18d5f94ec1c0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.716735:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707491.716736:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707491.716738:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787707491.717172:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787707491.717178:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff8bd386/0xc5f18d5f94ec1c15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.717187:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1787707491.717190:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707491.717194:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff8bd386/0xc5f18d5f94ec1c15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.717203:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff8bd386/0xc5f18d5f94ec1c15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.717559:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff8bd386/0xc5f18d5f94ec1c15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.717567:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff8bd386/0xc5f18d5f94ec1c15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.717641:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787707491.717652:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787707491.717656:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff8bd386/0xc5f18d5f94ec1c15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.717663:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3f8db400 already unused, calling callback (ffffffffc1630230) 00010000:00010000:0.0:1787707491.717667:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff8bd386/0xc5f18d5f94ec1c15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.717675:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff8bd386/0xc5f18d5f94ec1c15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.717688:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff8bd386/0xc5f18d5f94ec1c15 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.717695:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff8bd386/0xc5f18d5f94ec1c15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.717708:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707491.717714:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707491.717716:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787707491.718161:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787707491.718167:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050fedaf1/0xc5f18d5f94ec1c1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.718175:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1787707491.718178:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707491.718182:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050fedaf1/0xc5f18d5f94ec1c1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.718191:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050fedaf1/0xc5f18d5f94ec1c1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.718198:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050fedaf1/0xc5f18d5f94ec1c1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.718205:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050fedaf1/0xc5f18d5f94ec1c1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.718284:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787707491.718948:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787707491.718955:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000513e8345/0xc5f18d5f94ec1c23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.718965:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1787707491.718968:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707491.718972:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000513e8345/0xc5f18d5f94ec1c23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.718987:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000513e8345/0xc5f18d5f94ec1c23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.718995:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000513e8345/0xc5f18d5f94ec1c23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.719002:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000513e8345/0xc5f18d5f94ec1c23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.719016:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787707491.719025:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787707491.719031:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050fedaf1/0xc5f18d5f94ec1c1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.719037:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3f8daa00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:0.0:1787707491.719041:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050fedaf1/0xc5f18d5f94ec1c1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.719049:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050fedaf1/0xc5f18d5f94ec1c1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.719060:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050fedaf1/0xc5f18d5f94ec1c1c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.719067:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050fedaf1/0xc5f18d5f94ec1c1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.719087:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787707491.719090:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000513e8345/0xc5f18d5f94ec1c23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.719095:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3f8dbe00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:0.0:1787707491.719099:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000513e8345/0xc5f18d5f94ec1c23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.719106:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000513e8345/0xc5f18d5f94ec1c23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.719115:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000513e8345/0xc5f18d5f94ec1c23 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.719121:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000513e8345/0xc5f18d5f94ec1c23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.719137:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707491.719139:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707491.719141:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787707491.719886:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787707491.719894:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000326818d1/0xc5f18d5f94ec1c2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.719904:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1787707491.719912:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707491.719916:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000326818d1/0xc5f18d5f94ec1c2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.719926:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000326818d1/0xc5f18d5f94ec1c2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.719933:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000326818d1/0xc5f18d5f94ec1c2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.719940:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000326818d1/0xc5f18d5f94ec1c2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.719960:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787707491.720445:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787707491.720516:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000666dd304/0xc5f18d5f94ec1c31 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.720547:0:15300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707491.720556:0:15300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000326818d1/0xc5f18d5f94ec1c2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.720579:0:15300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3f8db200 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707491.720585:0:15300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000326818d1/0xc5f18d5f94ec1c2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.720592:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1787707491.720598:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707491.720599:0:15300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000326818d1/0xc5f18d5f94ec1c2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.720604:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000666dd304/0xc5f18d5f94ec1c31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.720621:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000666dd304/0xc5f18d5f94ec1c31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.720623:0:15300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000326818d1/0xc5f18d5f94ec1c2a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.720636:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000666dd304/0xc5f18d5f94ec1c31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.720638:0:15300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000326818d1/0xc5f18d5f94ec1c2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.720662:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000666dd304/0xc5f18d5f94ec1c31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.720669:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707491.720673:0:15300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707491.720677:0:15300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000666dd304/0xc5f18d5f94ec1c31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.720677:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787707491.720688:0:15300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3f8db800 already unused, calling callback (ffffffffc1630230) 00010000:00010000:0.0:1787707491.720690:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707491.720694:0:15300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000666dd304/0xc5f18d5f94ec1c31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.720704:0:15300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000666dd304/0xc5f18d5f94ec1c31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.720730:0:15300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000666dd304/0xc5f18d5f94ec1c31 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.720739:0:15300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000666dd304/0xc5f18d5f94ec1c31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.720759:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707491.720762:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707491.720766:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787707491.721203:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787707491.721210:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb658bc4/0xc5f18d5f94ec1c38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.721284:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1787707491.721352:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707491.721358:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb658bc4/0xc5f18d5f94ec1c38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.721385:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb658bc4/0xc5f18d5f94ec1c38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.721393:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb658bc4/0xc5f18d5f94ec1c38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.721401:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb658bc4/0xc5f18d5f94ec1c38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.721414:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787707491.721422:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787707491.721432:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb658bc4/0xc5f18d5f94ec1c38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.721439:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2a00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:0.0:1787707491.721443:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb658bc4/0xc5f18d5f94ec1c38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.721461:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb658bc4/0xc5f18d5f94ec1c38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.721475:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb658bc4/0xc5f18d5f94ec1c38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.721482:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb658bc4/0xc5f18d5f94ec1c38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.721500:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707491.721502:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707491.721504:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787707491.722201:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787707491.722209:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000704332e1/0xc5f18d5f94ec1c3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.722247:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707491.722284:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1787707491.722346:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707491.722352:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000704332e1/0xc5f18d5f94ec1c3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.722387:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000704332e1/0xc5f18d5f94ec1c3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.722396:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000704332e1/0xc5f18d5f94ec1c3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.722402:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000704332e1/0xc5f18d5f94ec1c3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.722418:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787707491.722458:0:15300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787707491.722466:0:15300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000704332e1/0xc5f18d5f94ec1c3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.722474:0:15300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2e00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707491.722478:0:15300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000704332e1/0xc5f18d5f94ec1c3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.722487:0:15300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000704332e1/0xc5f18d5f94ec1c3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.722503:0:15300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000704332e1/0xc5f18d5f94ec1c3f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.722511:0:15300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000704332e1/0xc5f18d5f94ec1c3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.722538:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707491.722540:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707491.722541:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787707491.722999:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787707491.723005:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7723c3d/0xc5f18d5f94ec1c46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.723014:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1787707491.723018:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707491.723022:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7723c3d/0xc5f18d5f94ec1c46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.723031:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7723c3d/0xc5f18d5f94ec1c46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.723038:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7723c3d/0xc5f18d5f94ec1c46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.723054:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7723c3d/0xc5f18d5f94ec1c46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.723079:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787707491.723111:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707491.723119:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7723c3d/0xc5f18d5f94ec1c46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.723127:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2400 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707491.723132:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7723c3d/0xc5f18d5f94ec1c46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.723141:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7723c3d/0xc5f18d5f94ec1c46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.723157:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7723c3d/0xc5f18d5f94ec1c46 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.723165:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7723c3d/0xc5f18d5f94ec1c46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.723199:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707491.723201:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707491.723205:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787707491.723924:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787707491.723931:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c51262d/0xc5f18d5f94ec1c4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.723941:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1787707491.723944:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707491.723948:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c51262d/0xc5f18d5f94ec1c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.723958:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c51262d/0xc5f18d5f94ec1c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.723965:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c51262d/0xc5f18d5f94ec1c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.723972:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c51262d/0xc5f18d5f94ec1c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.723994:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787707491.724630:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787707491.724638:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002a31641/0xc5f18d5f94ec1c54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.724653:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1787707491.724656:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707491.724660:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002a31641/0xc5f18d5f94ec1c54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.724669:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002a31641/0xc5f18d5f94ec1c54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.724677:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002a31641/0xc5f18d5f94ec1c54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.724685:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002a31641/0xc5f18d5f94ec1c54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.724706:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787707491.725412:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787707491.725422:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c51262d/0xc5f18d5f94ec1c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.725432:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2c00 already unused, calling callback (ffffffffc1630230) 00002000:00010000:0.0:1787707491.725436:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787707491.725437:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c51262d/0xc5f18d5f94ec1c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.725451:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c51262d/0xc5f18d5f94ec1c4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.725458:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f90c0dfb/0xc5f18d5f94ec1c5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.725470:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=542s v=(0 0) 00010000:00010000:2.0:1787707491.725471:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c51262d/0xc5f18d5f94ec1c4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.725475:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707491.725485:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f90c0dfb/0xc5f18d5f94ec1c5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.725487:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c51262d/0xc5f18d5f94ec1c4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.725509:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f90c0dfb/0xc5f18d5f94ec1c5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.725518:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787707491.725523:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002a31641/0xc5f18d5f94ec1c54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.725530:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3800 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707491.725541:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002a31641/0xc5f18d5f94ec1c54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.725549:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002a31641/0xc5f18d5f94ec1c54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.725560:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002a31641/0xc5f18d5f94ec1c54 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.725566:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002a31641/0xc5f18d5f94ec1c54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.725577:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707491.725579:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707491.725580:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707491.725642:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f90c0dfb/0xc5f18d5f94ec1c5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.725650:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f90c0dfb/0xc5f18d5f94ec1c5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.725677:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787707491.725818:0:15300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707491.725824:0:15300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f90c0dfb/0xc5f18d5f94ec1c5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.725832:0:15300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3e00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707491.725835:0:15300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f90c0dfb/0xc5f18d5f94ec1c5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.725843:0:15300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f90c0dfb/0xc5f18d5f94ec1c5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.725854:0:15300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f90c0dfb/0xc5f18d5f94ec1c5b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.725862:0:15300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f90c0dfb/0xc5f18d5f94ec1c5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.725875:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707491.725889:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707491.725891:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787707491.726356:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787707491.726363:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7d39274/0xc5f18d5f94ec1c62 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.726391:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1787707491.726395:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707491.726400:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7d39274/0xc5f18d5f94ec1c62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.726410:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7d39274/0xc5f18d5f94ec1c62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.726419:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7d39274/0xc5f18d5f94ec1c62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.726426:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7d39274/0xc5f18d5f94ec1c62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.726585:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787707491.728230:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787707491.728243:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f5d4eda/0xc5f18d5f94ec1c69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.728260:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1787707491.728264:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707491.728271:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f5d4eda/0xc5f18d5f94ec1c69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.728286:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f5d4eda/0xc5f18d5f94ec1c69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.728297:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f5d4eda/0xc5f18d5f94ec1c69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.728317:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f5d4eda/0xc5f18d5f94ec1c69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.729109:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787707491.729110:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707491.729121:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7d39274/0xc5f18d5f94ec1c62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.729134:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3c00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707491.729139:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7d39274/0xc5f18d5f94ec1c62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.729150:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7d39274/0xc5f18d5f94ec1c62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.729169:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7d39274/0xc5f18d5f94ec1c62 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.729184:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7d39274/0xc5f18d5f94ec1c62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.729206:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707491.729208:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707491.729211:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707491.730415:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787707491.730535:0:15300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707491.730544:0:15300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f5d4eda/0xc5f18d5f94ec1c69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.730569:0:15300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14c00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707491.730573:0:15300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f5d4eda/0xc5f18d5f94ec1c69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.730582:0:15300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f5d4eda/0xc5f18d5f94ec1c69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.730599:0:15300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f5d4eda/0xc5f18d5f94ec1c69 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.730607:0:15300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f5d4eda/0xc5f18d5f94ec1c69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.730625:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707491.730627:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707491.730629:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787707491.731264:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787707491.731274:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec1c70 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.731287:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1787707491.731292:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707491.731298:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec1c70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.731311:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec1c70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.731319:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec1c70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.731326:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec1c70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.731352:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787707491.731908:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787707491.731914:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5575ae4/0xc5f18d5f94ec1c77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.731929:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1787707491.731932:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707491.731936:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5575ae4/0xc5f18d5f94ec1c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.731945:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5575ae4/0xc5f18d5f94ec1c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.731953:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5575ae4/0xc5f18d5f94ec1c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.731960:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5575ae4/0xc5f18d5f94ec1c77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.731987:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787707491.732168:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787707491.732176:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec1c70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.732186:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14800 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707491.732191:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec1c70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.732201:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec1c70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.732241:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec1c70 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.732250:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086b814b3/0xc5f18d5f94ec1c70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.732266:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707491.732270:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5575ae4/0xc5f18d5f94ec1c77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.732277:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14000 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707491.732281:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5575ae4/0xc5f18d5f94ec1c77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.732290:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5575ae4/0xc5f18d5f94ec1c77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.732302:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5575ae4/0xc5f18d5f94ec1c77 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.732311:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5575ae4/0xc5f18d5f94ec1c77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.732325:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707491.732328:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707491.732337:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787707491.732476:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787707491.732481:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ae52c3e/0xc5f18d5f94ec1c7e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.732513:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1787707491.732516:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707491.732524:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ae52c3e/0xc5f18d5f94ec1c7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.732534:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ae52c3e/0xc5f18d5f94ec1c7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.732553:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ae52c3e/0xc5f18d5f94ec1c7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.732560:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ae52c3e/0xc5f18d5f94ec1c7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.732574:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787707491.732711:0:15300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707491.732718:0:15300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ae52c3e/0xc5f18d5f94ec1c7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.732727:0:15300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15200 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707491.732731:0:15300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ae52c3e/0xc5f18d5f94ec1c7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.732740:0:15300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ae52c3e/0xc5f18d5f94ec1c7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.732756:0:15300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ae52c3e/0xc5f18d5f94ec1c7e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.732765:0:15300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ae52c3e/0xc5f18d5f94ec1c7e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.732782:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707491.732784:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707491.732786:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787707491.732981:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787707491.732988:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1c85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.732996:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1787707491.732999:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707491.733003:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1c85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.733011:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1c85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.733018:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1c85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.733025:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1c85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.733049:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787707491.733058:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787707491.733061:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1c85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.733068:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14400 already unused, calling callback (ffffffffc1630230) 00010000:00010000:1.0:1787707491.733071:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1c85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.733079:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1c85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.733089:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1c85 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.733095:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a2ccbc3/0xc5f18d5f94ec1c85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.733107:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707491.733109:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707491.733110:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707491.733478:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787707491.733947:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787707491.733953:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1c8c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.733963:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1787707491.733972:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707491.733978:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1c8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.733989:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1c8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.733997:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1c8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.734004:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1c8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.734026:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787707491.734252:0:15300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707491.734258:0:15300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1c8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.734267:0:15300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14a00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707491.734272:0:15300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1c8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.734295:0:15300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1c8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.734310:0:15300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1c8c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.734319:0:15300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1c8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.734343:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707491.734346:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707491.734348:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787707491.734484:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787707491.734490:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efc16c90/0xc5f18d5f94ec1c93 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.734498:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1787707491.734501:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707491.734505:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efc16c90/0xc5f18d5f94ec1c93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.734515:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efc16c90/0xc5f18d5f94ec1c93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.734758:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efc16c90/0xc5f18d5f94ec1c93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.734772:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efc16c90/0xc5f18d5f94ec1c93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.734787:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787707491.734996:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787707491.735002:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efc16c90/0xc5f18d5f94ec1c93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.735011:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15800 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707491.735015:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efc16c90/0xc5f18d5f94ec1c93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.735024:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efc16c90/0xc5f18d5f94ec1c93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.735036:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efc16c90/0xc5f18d5f94ec1c93 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.735057:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efc16c90/0xc5f18d5f94ec1c93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707491.735075:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707491.735077:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707491.735080:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787707491.735179:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787707491.735185:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a852f12e/0xc5f18d5f94ec1c9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.735194:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1787707491.735197:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707491.735201:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a852f12e/0xc5f18d5f94ec1c9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.735210:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a852f12e/0xc5f18d5f94ec1c9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.735230:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a852f12e/0xc5f18d5f94ec1c9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.735237:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a852f12e/0xc5f18d5f94ec1c9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.735449:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787707491.735867:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787707491.735874:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c803188/0xc5f18d5f94ec1ca1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.735888:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1787707491.735891:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707491.735895:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c803188/0xc5f18d5f94ec1ca1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.735904:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c803188/0xc5f18d5f94ec1ca1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.735912:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c803188/0xc5f18d5f94ec1ca1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.735918:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c803188/0xc5f18d5f94ec1ca1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.735933:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787707491.735942:0:15300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787707491.735946:0:15300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a852f12e/0xc5f18d5f94ec1c9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.735953:0:15300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15600 already unused, calling callback (ffffffffc1630230) 00010000:00010000:1.0:1787707491.735958:0:15300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a852f12e/0xc5f18d5f94ec1c9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.735966:0:15300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a852f12e/0xc5f18d5f94ec1c9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.735973:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787707491.735982:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c803188/0xc5f18d5f94ec1ca1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.735992:0:15300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a852f12e/0xc5f18d5f94ec1c9a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.735993:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15a00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:0.0:1787707491.736000:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c803188/0xc5f18d5f94ec1ca1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.736005:0:15300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a852f12e/0xc5f18d5f94ec1c9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.736017:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c803188/0xc5f18d5f94ec1ca1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.736026:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707491.736029:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707491.736032:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707491.736034:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c803188/0xc5f18d5f94ec1ca1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.736043:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c803188/0xc5f18d5f94ec1ca1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.736063:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707491.736065:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707491.736068:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787707491.736248:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787707491.736570:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787707491.736576:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ed5e490/0xc5f18d5f94ec1ca8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.736763:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1787707491.736766:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707491.736770:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ed5e490/0xc5f18d5f94ec1ca8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.736780:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ed5e490/0xc5f18d5f94ec1ca8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.736788:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ed5e490/0xc5f18d5f94ec1ca8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.736794:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ed5e490/0xc5f18d5f94ec1ca8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.736820:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787707491.737230:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787707491.737236:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c186923d/0xc5f18d5f94ec1caf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.737244:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1787707491.737247:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707491.737251:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c186923d/0xc5f18d5f94ec1caf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.737319:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c186923d/0xc5f18d5f94ec1caf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.737327:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c186923d/0xc5f18d5f94ec1caf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.737334:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c186923d/0xc5f18d5f94ec1caf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.737443:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787707491.737846:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787707491.737853:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016891d89/0xc5f18d5f94ec1cb6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.737862:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1787707491.737871:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707491.737876:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016891d89/0xc5f18d5f94ec1cb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.737885:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016891d89/0xc5f18d5f94ec1cb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.737892:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016891d89/0xc5f18d5f94ec1cb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707491.737899:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016891d89/0xc5f18d5f94ec1cb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.737927:0:15300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787707491.737933:0:15300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ed5e490/0xc5f18d5f94ec1ca8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.737940:0:15300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4c00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707491.737945:0:15300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ed5e490/0xc5f18d5f94ec1ca8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.737952:0:15300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ed5e490/0xc5f18d5f94ec1ca8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.737967:0:15300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ed5e490/0xc5f18d5f94ec1ca8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.737973:0:15300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ed5e490/0xc5f18d5f94ec1ca8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.737990:0:15300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787707491.737993:0:15300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c186923d/0xc5f18d5f94ec1caf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.738005:0:15300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4200 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707491.738009:0:15300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c186923d/0xc5f18d5f94ec1caf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.738016:0:15300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c186923d/0xc5f18d5f94ec1caf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.738027:0:15300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c186923d/0xc5f18d5f94ec1caf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.738034:0:15300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c186923d/0xc5f18d5f94ec1caf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.738050:0:15300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787707491.738053:0:15300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016891d89/0xc5f18d5f94ec1cb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.738059:0:15300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4800 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707491.738062:0:15300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016891d89/0xc5f18d5f94ec1cb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.738069:0:15300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016891d89/0xc5f18d5f94ec1cb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.738078:0:15300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016891d89/0xc5f18d5f94ec1cb6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707491.738091:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707491.738092:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707491.738094:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707491.738134:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787707491.738139:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016891d89/0xc5f18d5f94ec1cb6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707491.738155:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787707491.738198:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787707491.738512:0:15115:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1787707491.738610:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14454:x1874546729790208:12345-0@lo:5:osp-pre-1-0.0 Request processed in 86861us (87337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707491.738620:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787707491.740112:0:14454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14454:1874546729790208:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787707491.740133:0:14454:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1787707491.740202:0:14454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3a57ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14454:1874546729790336:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787707491.740269:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707491.740316:0:14454:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1869de40 going to sleep for 11 seconds 00000100:00100000:3.0:1787707491.740452:0:15297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729790336 00000100:00100000:3.0:1787707491.740460:0:15297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729790336 00000100:00100000:3.0:1787707491.740522:0:15297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787707491.740535:0:15297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14454:x1874546729790336:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787707491.740578:0:15297:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1787707491.756333:0:15297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14454:x1874546729790336:12345-0@lo:5:osp-pre-1-0.0 Request processed in 15794us (16056us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787707491.756345:0:15297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787707491.756514:0:14454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3a57ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14454:1874546729790336:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787707491.756530:0:14454:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1787707492.222702:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707493.240870:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707494.200688:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787707494.200712:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729790464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787707494.200870:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707494.201017:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729790464 00000100:00100000:2.0:1787707494.201026:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729790464 00000100:00100000:2.0:1787707494.201096:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787707494.201106:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729790464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787707494.201143:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707494.201200:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729790464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707494.201208:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787707494.201263:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787707494.201332:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729790464:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787707494.266888:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787707494.355839:0:16192:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg446-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787707495.288706:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707496.315029:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707496.761768:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729790592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787707496.761882:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707496.761971:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729790592 00000100:00100000:2.0:1787707496.761981:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729790592 00000100:00100000:2.0:1787707496.762066:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787707496.762079:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874546729790592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787707496.762132:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707496.762203:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874546729790592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707496.762225:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787707496.762293:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729790592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787707496.766593:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a4807cb1-ea3f-4016-a232-153195075fb5:3315:1874546729790720:0@lo:400:kworker.0 00000100:00100000:1.0:1787707496.766716:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707496.766757:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729790848:0@lo:400:kworker.0 00000100:00100000:1.0:1787707496.766800:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729791232:0@lo:400:kworker.0 00000100:00100000:1.0:1787707496.766844:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707496.766887:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707496.766918:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787707496.766925:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729790976:0@lo:400:kworker.0 00000100:00100000:2.0:1787707496.766955:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707496.767008:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729790848 00000100:00100000:2.0:1787707496.767017:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729790848 00000100:00100000:2.0:1787707496.767094:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787707496.767106:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729790848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707496.767184:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729790848:12345-0@lo:400:kworker.0 Request processed in 80us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707496.767192:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787707496.767222:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729791232 00000100:00100000:2.0:1787707496.767227:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729791232 00000100:00100000:2.0:1787707496.767256:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729790976 00000100:00100000:2.0:1787707496.767259:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729790976 00000100:00100000:2.0:1787707496.767282:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787707496.767290:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729791232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707496.767327:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729791232:12345-0@lo:400:kworker.0 Request processed in 38us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707496.767334:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787707496.767345:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787707496.767352:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729790976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707496.767730:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787707496.767747:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874546729791104:0@lo:400:kworker.0 00000100:00100000:1.0:1787707496.767786:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707496.769223:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729791104 00000100:00080000:3.0:1787707496.769234:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787707496.769238:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729791104 00000100:00080000:3.0:1787707496.769245:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787707496.769250:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787707496.769558:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787707496.769570:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874546729791104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707496.769672:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874546729791104:12345-0@lo:400:kworker.0 Request processed in 104us (1885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707496.769679:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787707496.769701:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787707496.769748:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729790848:0@lo:400:kworker.0 00000100:00100000:2.0:1787707496.769842:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729790976:12345-0@lo:400:kworker.0 Request processed in 2489us (2885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707496.769850:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787707496.769877:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa2f156a00 x1874546729791104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787707496.769888:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa2f154000 x1874546729790976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707496.769896:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874546729791104:0@lo:400:kworker.0 00000100:00100000:2.0:1787707496.769910:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729790976:0@lo:400:kworker.0 00010000:00080000:1.0:1787707496.769922:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfa2f155f80 x1874546729791232/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787707512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787707496.769934:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729791232:0@lo:400:kworker.0 00000100:00100000:1.0:1787707496.769977:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729790720 00000100:00100000:1.0:1787707496.769984:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729790720 00000100:00100000:1.0:1787707496.774103:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787707496.774141:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+19:3315:x1874546729790720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707496.774275:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+19:3315:x1874546729790720:12345-0@lo:400:kworker.0 Request processed in 154us (7561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707496.774284:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787707496.774528:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a4807cb1-ea3f-4016-a232-153195075fb5:3315:1874546729790720:0@lo:400:kworker.0 00000001:00080000:0.0:1787707496.876567:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1787707496.876587:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787707497.014524:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707497.014702:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707769216 00000100:00100000:0.0:1787707497.014719:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707769216 00000100:00100000:0.0:1787707497.014782:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 78 00000100:00100000:0.0:1787707497.014793:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2358:x1874546707769216:12345-192.168.204.46@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787707497.014834:0:14422:0:(ldlm_lib.c:1455:target_handle_connect()) MGS: connection from ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8@192.168.204.46@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:0.0:1787707497.014878:0:14422:0:(genops.c:1385:class_connect()) connect: client ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8, cookie 0xc5f18d5f94ec1cbd 00000100:00080000:0.0:1787707497.015085:0:14422:0:(import.c:65:import_set_state_nolock()) ffff8cf901f95000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787707497.015202:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+5:2358:x1874546707769216:12345-192.168.204.46@tcp:250:mount.lustre.0 Request processed in 408us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707497.015212:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 78 00000100:00100000:2.0:1787707497.032789:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707497.034018:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707769344 00000100:00100000:1.0:1787707497.034035:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707769344 00000100:00100000:1.0:1787707497.034161:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 79 00000100:00100000:1.0:1787707497.034175:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+5:13790:x1874546707769344:12345-192.168.204.46@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787707497.034201:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707497.034227:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa029d5400/0xc5f18d5f94ec1cc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba055 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707497.034267:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa029d5400/0xc5f18d5f94ec1cc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba055 expref: 6 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707497.034281:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa029d5400/0xc5f18d5f94ec1cc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba055 expref: 6 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707497.034292:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d5400, rc 0) 00000100:00100000:1.0:1787707497.034712:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+6:13790:x1874546707769344:12345-192.168.204.46@tcp:101:mount.lustre.0 Request processed in 537us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707497.034722:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 79 00000100:00100000:2.0:1787707497.044309:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707497.049687:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707769472 00000100:00100000:1.0:1787707497.049710:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707769472 00000100:00100000:1.0:1787707497.049869:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 80 00000100:00100000:1.0:1787707497.049883:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+6:13790:x1874546707769472:12345-192.168.204.46@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787707497.051755:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+6:13790:x1874546707769472:12345-192.168.204.46@tcp:501:mount.lustre.0 Request processed in 1859us (7446us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787707497.051773:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 80 00000100:00100000:2.0:1787707497.061188:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707497.065093:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707769600 00000100:00100000:1.0:1787707497.065125:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707769600 00000100:00100000:0.0:1787707497.065697:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 81 00000100:00100000:0.0:1787707497.065712:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+6:13790:x1874546707769600:12345-192.168.204.46@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787707497.065740:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707497.065767:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1ccb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba05c expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707497.065809:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1ccb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba05c expref: 7 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707497.065821:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa3fcd3a00/0xc5f18d5f94ec1ccb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba05c expref: 7 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707497.065858:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3a00, rc 0) 00000100:00100000:0.0:1787707497.065988:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+7:13790:x1874546707769600:12345-192.168.204.46@tcp:101:mount.lustre.0 Request processed in 278us (4813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707497.066074:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 81 00000100:00100000:3.0:1787707497.070938:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707497.077827:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707769728 00000100:00100000:2.0:1787707497.077850:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707769728 00000100:00100000:2.0:1787707497.077945:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 82 00000100:00100000:2.0:1787707497.077958:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+7:13790:x1874546707769728:12345-192.168.204.46@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787707497.079559:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+8:13790:x1874546707769728:12345-192.168.204.46@tcp:501:mount.lustre.0 Request processed in 1592us (8629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707497.080591:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 82 00000100:00100000:3.0:1787707497.082877:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707497.083039:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707769856 00000100:00100000:2.0:1787707497.083053:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707769856 00000100:00100000:2.0:1787707497.083134:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 83 00000100:00100000:2.0:1787707497.083148:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+8:13790:x1874546707769856:12345-192.168.204.46@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787707497.083674:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+8:13790:x1874546707769856:12345-192.168.204.46@tcp:503:mount.lustre.0 Request processed in 527us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707497.083684:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 83 00000100:00100000:2.0:1787707497.093830:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707497.093960:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707769984 00000100:00100000:0.0:1787707497.093973:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707769984 00000100:00100000:0.0:1787707497.094056:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 84 00000100:00100000:0.0:1787707497.094069:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+8:13809:x1874546707769984:12345-192.168.204.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787707497.094759:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+8:13809:x1874546707769984:12345-192.168.204.46@tcp:502:llog_process_th.0 Request processed in 689us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707497.094770:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 84 00000100:00100000:2.0:1787707497.129332:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707497.130337:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707770112 00000100:00100000:1.0:1787707497.130353:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707770112 00000100:00100000:1.0:1787707497.130560:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 85 00000100:00100000:1.0:1787707497.130594:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+8:13809:x1874546707770112:12345-192.168.204.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787707497.131016:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+8:13809:x1874546707770112:12345-192.168.204.46@tcp:502:llog_process_th.0 Request processed in 424us (1697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707497.131026:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 85 00000100:00100000:3.0:1787707497.134221:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707497.135327:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707770240 00000100:00100000:2.0:1787707497.135342:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707770240 00000100:00100000:2.0:1787707497.135421:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 86 00000100:00100000:2.0:1787707497.135434:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+8:13790:x1874546707770240:12345-192.168.204.46@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787707497.135526:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707497.135551:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa0871b000/0xc5f18d5f94ec1cd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba086 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707497.135592:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa0871b000/0xc5f18d5f94ec1cd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba086 expref: 9 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707497.135606:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa0871b000/0xc5f18d5f94ec1cd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba086 expref: 9 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707497.135617:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871b000, rc 0) 00000100:00100000:2.0:1787707497.135744:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+9:13790:x1874546707770240:12345-192.168.204.46@tcp:101:mount.lustre.0 Request processed in 312us (1535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707497.135775:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 86 00000100:00100000:3.0:1787707497.140670:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707497.140813:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707770368 00000100:00100000:2.0:1787707497.140827:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707770368 00000100:00100000:2.0:1787707497.142719:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 87 00000100:00100000:2.0:1787707497.142750:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3cb0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+9:13790:x1874546707770368:12345-192.168.204.46@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787707497.142789:0:14422:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787707497.142825:0:14422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787707497.142830:0:14422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787707497.142834:0:14422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787707497.142837:0:14422:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787707497.152313:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3cb0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+9:13790:x1874546707770368:12345-192.168.204.46@tcp:256:mount.lustre.0 Request processed in 9559us (11639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707497.152335:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 87 00000100:00100000:1.0:1787707497.156523:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707497.156689:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707770496 00000100:00100000:0.0:1787707497.156704:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707770496 00000100:00100000:0.0:1787707497.156777:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 88 00000100:00100000:0.0:1787707497.156791:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf9012b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+9:13790:x1874546707770496:12345-192.168.204.46@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787707497.156814:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707497.156839:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1cd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba08d expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707497.156881:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1cd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba08d expref: 10 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707497.156893:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1cd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba08d expref: 10 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707497.156916:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3000, rc 0) 00000100:00100000:0.0:1787707497.157130:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf9012b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+10:13790:x1874546707770496:12345-192.168.204.46@tcp:101:mount.lustre.0 Request processed in 340us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707497.157137:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 88 00000100:00100000:3.0:1787707497.159442:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707497.159557:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707770624 00000100:00100000:1.0:1787707497.159571:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707770624 00000100:00100000:1.0:1787707497.159635:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 89 00000100:00100000:1.0:1787707497.159647:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf9012b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+10:13790:x1874546707770624:12345-192.168.204.46@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787707497.160216:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf9012b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+10:13790:x1874546707770624:12345-192.168.204.46@tcp:501:mount.lustre.0 Request processed in 568us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707497.160227:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 89 00000100:00100000:2.0:1787707497.163124:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707497.163782:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707770752 00000100:00100000:1.0:1787707497.163797:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707770752 00000100:00100000:1.0:1787707497.163876:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 90 00000100:00100000:1.0:1787707497.163889:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf9012b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+10:13790:x1874546707770752:12345-192.168.204.46@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787707497.164307:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf9012b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+10:13790:x1874546707770752:12345-192.168.204.46@tcp:503:mount.lustre.0 Request processed in 419us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707497.164318:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 90 00000100:00100000:2.0:1787707497.170343:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707497.174819:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707770880 00000100:00100000:0.0:1787707497.174842:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707770880 00000100:00100000:0.0:1787707497.175708:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 91 00000100:00100000:0.0:1787707497.175727:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf9012b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+10:13813:x1874546707770880:12345-192.168.204.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787707497.176123:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf9012b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+10:13813:x1874546707770880:12345-192.168.204.46@tcp:502:llog_process_th.0 Request processed in 401us (5802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707497.176133:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 91 00000100:00100000:3.0:1787707497.188259:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707497.191728:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707771008 00000100:00100000:0.0:1787707497.191753:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707771008 00000100:00100000:2.0:1787707497.192193:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 92 00000100:00100000:2.0:1787707497.192209:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf9012b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+10:13813:x1874546707771008:12345-192.168.204.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787707497.193828:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf9012b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+10:13813:x1874546707771008:12345-192.168.204.46@tcp:502:llog_process_th.0 Request processed in 1610us (5595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707497.193846:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 92 00000100:00100000:2.0:1787707497.218107:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707497.218223:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707771136 00000100:00100000:3.0:1787707497.218239:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707771136 00000100:00100000:3.0:1787707497.218350:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 4 00000100:00100000:3.0:1787707497.218361:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1874546707771136:12345-192.168.204.46@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787707497.218448:0:14431:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-MDT0000: connection from b9f4cba3-9e74-47aa-919e-a4582dd7e4ec@192.168.204.46@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:3.0:1787707497.218527:0:14431:0:(genops.c:1385:class_connect()) connect: client b9f4cba3-9e74-47aa-919e-a4582dd7e4ec, cookie 0xc5f18d5f94ec1ce0 00000004:00100000:3.0:1787707497.218574:0:14431:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787707497.218582:0:14431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1787707497.260627:0:14431:0:(import.c:65:import_set_state_nolock()) ffff8cf901dc9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787707497.260770:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+6:2358:x1874546707771136:12345-192.168.204.46@tcp:38:mount.lustre.0 Request processed in 42407us (42679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707497.260783:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 4 00000100:00100000:1.0:1787707497.268212:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707497.268263:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707497.268442:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707771392 00000100:00100000:2.0:1787707497.268521:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707771392 00000100:00100000:0.0:1787707497.268646:0:15848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707771264 00000100:00100000:0.0:1787707497.268652:0:15848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707771264 00000100:00100000:0.0:1787707497.268732:0:15848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 5 00000100:00100000:0.0:1787707497.268746:0:15848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+7:0:x1874546707771264:12345-192.168.204.46@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787707497.268817:0:15848:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787707497.268930:0:15848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+7:0:x1874546707771264:12345-192.168.204.46@tcp:41:mount.lustre.0 Request processed in 186us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707497.268939:0:15848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 5 00000100:00100000:2.0:1787707497.269192:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 6 00000100:00100000:2.0:1787707497.269202:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+6:13790:x1874546707771392:12345-192.168.204.46@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787707497.269236:0:14430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787707497.269268:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+6:13790:x1874546707771392:12345-192.168.204.46@tcp:41:mount.lustre.0 Request processed in 70us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707497.269276:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 6 00000100:00080000:3.0:1787707497.271652:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787707497.271968:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707497.272211:0:15848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707771520 00000100:00100000:3.0:1787707497.272225:0:15848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707771520 00000100:00100000:3.0:1787707497.272307:0:15848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 7 00000100:00100000:3.0:1787707497.272321:0:15848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+6:13790:x1874546707771520:12345-192.168.204.46@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787707497.273240:0:15848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+6:13790:x1874546707771520:12345-192.168.204.46@tcp:40:mount.lustre.0 Request processed in 916us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707497.273252:0:15848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 7 00000100:00100000:2.0:1787707497.275801:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707497.276769:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707497.277250:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707497.277356:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707771648 00000100:00100000:0.0:1787707497.277391:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707771648 00000100:00100000:0.0:1787707497.277443:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707771776 00000100:00100000:0.0:1787707497.277447:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707771776 00000100:00100000:0.0:1787707497.277469:0:15113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 10 00000100:00100000:0.0:1787707497.277480:0:15113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1874546707771648:12345-192.168.204.46@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787707497.277525:0:15113:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-OST0000: connection from b9f4cba3-9e74-47aa-919e-a4582dd7e4ec@192.168.204.46@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:0.0:1787707497.277597:0:15113:0:(genops.c:1385:class_connect()) connect: client b9f4cba3-9e74-47aa-919e-a4582dd7e4ec, cookie 0xc5f18d5f94ec1ce7 00002000:00100000:0.0:1787707497.277613:0:15113:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b9f4cba3-9e74-47aa-919e-a4582dd7e4ec/ffff8cf901f97800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787707497.277648:0:15113:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1787707497.278054:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 11 00000100:00100000:2.0:1787707497.278062:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1874546707771776:12345-192.168.204.46@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787707497.278084:0:15116:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-OST0001: connection from b9f4cba3-9e74-47aa-919e-a4582dd7e4ec@192.168.204.46@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:2.0:1787707497.278125:0:15116:0:(genops.c:1385:class_connect()) connect: client b9f4cba3-9e74-47aa-919e-a4582dd7e4ec, cookie 0xc5f18d5f94ec1cee 00002000:00100000:2.0:1787707497.278131:0:15116:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b9f4cba3-9e74-47aa-919e-a4582dd7e4ec/ffff8cf901c94000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787707497.278139:0:15116:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787707497.278482:0:15116:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787707497.278523:0:15116:0:(import.c:65:import_set_state_nolock()) ffff8cf901c93800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787707497.278629:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+6:2358:x1874546707771776:12345-192.168.204.46@tcp:8:mount.lustre.0 Request processed in 565us (1865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707497.278638:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 11 00002000:00080000:0.0:1787707497.279363:0:15113:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787707497.279411:0:15113:0:(import.c:65:import_set_state_nolock()) ffff8cf901f93800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787707497.279459:0:15113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+6:2358:x1874546707771648:12345-192.168.204.46@tcp:8:mount.lustre.0 Request processed in 1979us (3671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707497.279468:0:15113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 10 00000100:00100000:2.0:1787707497.280682:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707771904 00000100:00100000:2.0:1787707497.280702:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707771904 00000100:00100000:2.0:1787707497.280777:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 0 00000100:00100000:2.0:1787707497.280788:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+6:13790:x1874546707771904:12345-192.168.204.46@tcp:33:mount.lustre.0 00000004:00080000:2.0:1787707497.287161:0:14432:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6287us 00000004:00200000:2.0:1787707497.301041:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787707497.301294:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+6:13790:x1874546707771904:12345-192.168.204.46@tcp:33:mount.lustre.0 Request processed in 20498us (24035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707497.301327:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 0 00010000:00010000:3.0:1787707497.336781:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707497.574048:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707497.574253:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707772032 00000100:00100000:1.0:1787707497.574288:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707772032 00000100:00100000:1.0:1787707497.574446:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 8 00000100:00100000:1.0:1787707497.574459:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+6:13834:x1874546707772032:12345-192.168.204.46@tcp:101:mkdir.0 00010000:00010000:1.0:1787707497.574489:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707497.574528:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec1cf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba0b7 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707497.574625:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1cfc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707497.574642:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1cfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707497.574659:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1cfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707497.574963:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787707497.574968:0:14429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787707497.575631:0:14429:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1cfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707497.575675:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5a00/0xc5f18d5f94ec1cf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba0b7 expref: 8 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707497.575699:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1cfc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba0b7 expref: 7 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707497.575710:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa06897400) 00010000:00010000:1.0:1787707497.575713:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787707497.575718:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d4000, rc 0) 00000100:00100000:1.0:1787707497.575806:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+7:13834:x1874546707772032:12345-192.168.204.46@tcp:101:mkdir.0 Request processed in 1349us (1772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707497.575815:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 8 00010000:00010000:2.0:1787707498.360678:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707499.323578:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787707499.323615:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729791360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787707499.323716:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707499.326145:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729791360 00000100:00100000:2.0:1787707499.326165:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729791360 00000100:00100000:2.0:1787707499.326265:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787707499.326279:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729791360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787707499.326326:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707499.326481:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729791360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 205us (2765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707499.326491:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787707499.326650:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787707499.326752:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729791360:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787707499.384715:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707499.597545:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707499.597738:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707772160 00000100:00100000:0.0:1787707499.597753:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707772160 00000100:00100000:0.0:1787707499.597848:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 9 00000100:00100000:0.0:1787707499.597864:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+7:13886:x1874546707772160:12345-192.168.204.46@tcp:41:lfs.0 00000004:00000024:0.0:1787707499.597932:0:14430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787707499.598073:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+7:13886:x1874546707772160:12345-192.168.204.46@tcp:41:lfs.0 Request processed in 202us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707499.598083:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 9 00000100:00080000:2.0:1787707499.598567:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787707499.626768:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707499.628320:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707772288 00000100:00100000:1.0:1787707499.628338:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707772288 00000100:00100000:1.0:1787707499.628614:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 8 00000100:00100000:1.0:1787707499.628628:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+6:13886:x1874546707772288:12345-192.168.204.46@tcp:13:lfs.0 00002000:00000024:1.0:1787707499.628661:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787707499.628783:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+6:13886:x1874546707772288:12345-192.168.204.46@tcp:13:lfs.0 Request processed in 158us (2034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707499.628791:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 8 00000100:00080000:2.0:1787707499.630908:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787707499.642949:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707499.643074:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707772416 00000100:00100000:3.0:1787707499.643087:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707772416 00000100:00100000:3.0:1787707499.643178:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 9 00000100:00100000:3.0:1787707499.643191:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+6:13886:x1874546707772416:12345-192.168.204.46@tcp:13:lfs.0 00002000:00000024:3.0:1787707499.643243:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787707499.643361:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+6:13886:x1874546707772416:12345-192.168.204.46@tcp:13:lfs.0 Request processed in 172us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707499.643396:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 9 00000100:00080000:2.0:1787707499.643562:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787707499.903775:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707499.903894:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707772544 00000100:00100000:3.0:1787707499.903909:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707772544 00000100:00100000:3.0:1787707499.903994:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 93 00000100:00100000:3.0:1787707499.904027:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf9012b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+10:13917:x1874546707772544:12345-192.168.204.46@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787707499.904052:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707499.904089:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa013fce00/0xc5f18d5f94ec1d03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba0be expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707499.904295:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa013fce00/0xc5f18d5f94ec1d03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba0be expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707499.904310:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa013fce00/0xc5f18d5f94ec1d03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba0be expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707499.904321:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa013fce00, rc 0) 00000100:00100000:3.0:1787707499.904450:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf9012b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+11:13917:x1874546707772544:12345-192.168.204.46@tcp:101:mount.lustre.0 Request processed in 424us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707499.904459:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 93 00000100:00100000:0.0:1787707499.911075:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707499.918399:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707772672 00000100:00100000:2.0:1787707499.918422:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707772672 00000100:00100000:2.0:1787707499.918525:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 94 00000100:00100000:2.0:1787707499.918539:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf9012b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+11:13917:x1874546707772672:12345-192.168.204.46@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787707499.920908:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf9012b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+11:13917:x1874546707772672:12345-192.168.204.46@tcp:501:mount.lustre.0 Request processed in 2352us (9845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707499.920927:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 94 00000100:00100000:0.0:1787707499.940006:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707499.949981:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707772800 00000100:00100000:1.0:1787707499.950010:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707772800 00000100:00100000:1.0:1787707499.950131:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 95 00000100:00100000:1.0:1787707499.950146:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf9012b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+11:13917:x1874546707772800:12345-192.168.204.46@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787707499.950540:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf9012b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+11:13917:x1874546707772800:12345-192.168.204.46@tcp:503:mount.lustre.0 Request processed in 396us (10550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707499.950549:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 95 00000100:00100000:0.0:1787707499.965875:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707499.969280:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707772928 00000100:00100000:2.0:1787707499.969306:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707772928 00000100:00100000:2.0:1787707499.969437:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 96 00000100:00100000:2.0:1787707499.969452:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+11:13925:x1874546707772928:12345-192.168.204.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787707499.969914:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+11:13925:x1874546707772928:12345-192.168.204.46@tcp:502:llog_process_th.0 Request processed in 463us (4051us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707499.969925:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 96 00000100:00100000:2.0:1787707500.000673:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707500.000766:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707773056 00000100:00100000:3.0:1787707500.000781:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707773056 00000100:00100000:3.0:1787707500.000849:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 97 00000100:00100000:3.0:1787707500.000860:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+11:13925:x1874546707773056:12345-192.168.204.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787707500.001238:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+11:13925:x1874546707773056:12345-192.168.204.46@tcp:502:llog_process_th.0 Request processed in 378us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707500.001247:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 97 00000100:00100000:0.0:1787707500.008820:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707500.008952:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707773184 00000100:00100000:1.0:1787707500.008969:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707773184 00000100:00100000:1.0:1787707500.009071:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 98 00000100:00100000:1.0:1787707500.009087:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+11:13917:x1874546707773184:12345-192.168.204.46@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787707500.009146:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707500.009173:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa029d5a00/0xc5f18d5f94ec1d0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba0e8 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707500.009212:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa029d5a00/0xc5f18d5f94ec1d0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba0e8 expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707500.009225:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa029d5a00/0xc5f18d5f94ec1d0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba0e8 expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707500.009236:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d5a00, rc 0) 00000100:00100000:1.0:1787707500.009321:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+12:13917:x1874546707773184:12345-192.168.204.46@tcp:101:mount.lustre.0 Request processed in 237us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707500.009329:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 98 00000100:00100000:0.0:1787707500.019174:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707500.019285:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707773312 00000100:00100000:2.0:1787707500.019301:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707773312 00000100:00100000:2.0:1787707500.019423:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 99 00000100:00100000:2.0:1787707500.019438:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+12:13917:x1874546707773312:12345-192.168.204.46@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787707500.019473:0:14422:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787707500.019508:0:14422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787707500.019513:0:14422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787707500.019517:0:14422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787707500.019520:0:14422:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787707500.021844:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+12:13917:x1874546707773312:12345-192.168.204.46@tcp:256:mount.lustre.0 Request processed in 2393us (2671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707500.021862:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 99 00000100:00100000:0.0:1787707500.033822:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707500.033962:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707773440 00000100:00100000:3.0:1787707500.033977:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707773440 00000100:00100000:3.0:1787707500.034053:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 100 00000100:00100000:3.0:1787707500.034076:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+12:13917:x1874546707773440:12345-192.168.204.46@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787707500.034122:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707500.034146:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec1d11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba0ef expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707500.034187:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec1d11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba0ef expref: 13 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707500.034202:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec1d11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba0ef expref: 13 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707500.034214:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa013fc600, rc 0) 00000100:00100000:3.0:1787707500.034298:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+13:13917:x1874546707773440:12345-192.168.204.46@tcp:101:mount.lustre.0 Request processed in 225us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707500.034307:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 100 00000100:00100000:0.0:1787707500.037632:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707500.040002:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707773568 00000100:00100000:2.0:1787707500.040023:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707773568 00000100:00100000:2.0:1787707500.040129:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 101 00000100:00100000:2.0:1787707500.040143:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+13:13917:x1874546707773568:12345-192.168.204.46@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787707500.040750:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+13:13917:x1874546707773568:12345-192.168.204.46@tcp:501:mount.lustre.0 Request processed in 607us (3130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707500.040774:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 101 00000100:00100000:0.0:1787707500.050632:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707500.050805:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707773696 00000100:00100000:1.0:1787707500.050819:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707773696 00000100:00100000:1.0:1787707500.050902:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 102 00000100:00100000:1.0:1787707500.050916:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+13:13917:x1874546707773696:12345-192.168.204.46@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787707500.051428:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+13:13917:x1874546707773696:12345-192.168.204.46@tcp:503:mount.lustre.0 Request processed in 513us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707500.051440:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 102 00000100:00100000:0.0:1787707500.067669:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707500.068750:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707773824 00000100:00100000:3.0:1787707500.068769:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707773824 00000100:00100000:3.0:1787707500.068916:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 103 00000100:00100000:3.0:1787707500.068929:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+13:13929:x1874546707773824:12345-192.168.204.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787707500.069311:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+13:13929:x1874546707773824:12345-192.168.204.46@tcp:502:llog_process_th.0 Request processed in 382us (1656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707500.069322:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 103 00000100:00100000:0.0:1787707500.085037:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707500.085185:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707773952 00000100:00100000:3.0:1787707500.085200:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707773952 00000100:00100000:3.0:1787707500.085277:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 104 00000100:00100000:3.0:1787707500.085291:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+13:13929:x1874546707773952:12345-192.168.204.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787707500.087717:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+13:13929:x1874546707773952:12345-192.168.204.46@tcp:502:llog_process_th.0 Request processed in 2410us (2815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707500.087763:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 104 00000100:00100000:0.0:1787707500.097832:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707500.098231:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707774080 00000100:00100000:2.0:1787707500.098245:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707774080 00000100:00100000:2.0:1787707500.098307:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 10 00000100:00100000:2.0:1787707500.098318:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1874546707774080:12345-192.168.204.46@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787707500.098355:0:14431:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-MDT0000: connection from f288ac8a-880e-4537-b6b8-0ab57669b2f5@192.168.204.46@tcp t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:2.0:1787707500.098671:0:14431:0:(genops.c:1385:class_connect()) connect: client f288ac8a-880e-4537-b6b8-0ab57669b2f5, cookie 0xc5f18d5f94ec1d18 00000004:00100000:2.0:1787707500.098715:0:14431:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787707500.100079:0:14431:0:(import.c:65:import_set_state_nolock()) ffff8cf901c91000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787707500.100202:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f288ac8a-880e-4537-b6b8-0ab57669b2f5+6:2358:x1874546707774080:12345-192.168.204.46@tcp:38:mount.lustre.0 Request processed in 1880us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707500.100215:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 10 00000100:00100000:0.0:1787707500.109692:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707500.109746:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707500.111129:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707774336 00000100:00100000:2.0:1787707500.111147:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707774336 00000100:00100000:2.0:1787707500.111241:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707774208 00000100:00100000:2.0:1787707500.111244:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707774208 00000100:00100000:2.0:1787707500.111273:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 11 00000100:00100000:2.0:1787707500.111284:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+7:13917:x1874546707774336:12345-192.168.204.46@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787707500.111344:0:14430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787707500.111424:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 12 00000100:00100000:1.0:1787707500.111446:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+7:0:x1874546707774208:12345-192.168.204.46@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787707500.111461:0:14429:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787707500.111489:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+7:13917:x1874546707774336:12345-192.168.204.46@tcp:41:mount.lustre.0 Request processed in 205us (1813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707500.111489:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+7:0:x1874546707774208:12345-192.168.204.46@tcp:41:mount.lustre.0 Request processed in 48us (1742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707500.111499:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 11 00000100:00100000:1.0:1787707500.111520:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 12 00000100:00080000:0.0:1787707500.111995:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707500.130359:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707500.130574:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707774464 00000100:00100000:2.0:1787707500.130588:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707774464 00000100:00100000:2.0:1787707500.130709:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 13 00000100:00100000:2.0:1787707500.130723:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+6:13917:x1874546707774464:12345-192.168.204.46@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787707500.130871:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+6:13917:x1874546707774464:12345-192.168.204.46@tcp:40:mount.lustre.0 Request processed in 150us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707500.130881:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 13 00000100:00100000:2.0:1787707500.136734:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707500.136808:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707500.139467:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707774592 00000100:00100000:3.0:1787707500.139489:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707774592 00000100:00100000:3.0:1787707500.139714:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707774720 00000100:00100000:3.0:1787707500.139720:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707774720 00000100:00100000:3.0:1787707500.139751:0:15113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 12 00000100:00100000:1.0:1787707500.139764:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 13 00000100:00100000:1.0:1787707500.139772:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1874546707774720:12345-192.168.204.46@tcp:8:mount.lustre.0 00000100:00100000:3.0:1787707500.139858:0:15113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1874546707774592:12345-192.168.204.46@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787707500.139888:0:15115:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-OST0001: connection from f288ac8a-880e-4537-b6b8-0ab57669b2f5@192.168.204.46@tcp t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:1.0:1787707500.140005:0:15115:0:(genops.c:1385:class_connect()) connect: client f288ac8a-880e-4537-b6b8-0ab57669b2f5, cookie 0xc5f18d5f94ec1d1f 00002000:00100000:1.0:1787707500.140021:0:15115:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f288ac8a-880e-4537-b6b8-0ab57669b2f5/ffff8cf902270800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787707500.140037:0:15115:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787707500.140201:0:15115:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787707500.140248:0:15115:0:(import.c:65:import_set_state_nolock()) ffff8cf902275800 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1787707500.146164:0:15113:0:(ldlm_lib.c:1455:target_handle_connect()) lustre-OST0000: connection from f288ac8a-880e-4537-b6b8-0ab57669b2f5@192.168.204.46@tcp t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:3.0:1787707500.146225:0:15113:0:(genops.c:1385:class_connect()) connect: client f288ac8a-880e-4537-b6b8-0ab57669b2f5, cookie 0xc5f18d5f94ec1d26 00002000:00100000:3.0:1787707500.146244:0:15113:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f288ac8a-880e-4537-b6b8-0ab57669b2f5/ffff8cf901dca800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787707500.146260:0:15113:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787707500.146744:0:15113:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787707500.146792:0:15113:0:(import.c:65:import_set_state_nolock()) ffff8cf901dcf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787707500.147039:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+6:2358:x1874546707774720:12345-192.168.204.46@tcp:8:mount.lustre.0 Request processed in 7262us (10230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707500.147065:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 13 00000100:00100000:3.0:1787707500.148284:0:15113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+6:2358:x1874546707774592:12345-192.168.204.46@tcp:8:mount.lustre.0 Request processed in 8511us (11753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707500.148299:0:15113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 12 00000100:00100000:0.0:1787707500.151299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707500.153651:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707774848 00000100:00100000:3.0:1787707500.153674:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707774848 00000100:00100000:3.0:1787707500.153750:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 1 00000100:00100000:3.0:1787707500.153764:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+6:13917:x1874546707774848:12345-192.168.204.46@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787707500.155010:0:14433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787707500.155261:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+6:13917:x1874546707774848:12345-192.168.204.46@tcp:33:mount.lustre.0 Request processed in 1495us (3970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707500.155272:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 1 00000100:00100000:2.0:1787707500.380792:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707500.383130:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707774976 00000100:00100000:3.0:1787707500.383173:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707774976 00000100:00100000:3.0:1787707500.383256:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 14 00000100:00100000:3.0:1787707500.383268:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+6:13950:x1874546707774976:12345-192.168.204.46@tcp:101:mkdir.0 00010000:00010000:3.0:1787707500.383293:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707500.383320:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fdc00/0xc5f18d5f94ec1d2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba119 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707500.383429:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc000/0xc5f18d5f94ec1d34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707500.383444:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc000/0xc5f18d5f94ec1d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707500.383460:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc000/0xc5f18d5f94ec1d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707500.383685:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787707500.383690:0:14429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787707500.383782:0:14429:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc000/0xc5f18d5f94ec1d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707500.383815:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fdc00/0xc5f18d5f94ec1d2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba119 expref: 8 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707500.383836:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc000/0xc5f18d5f94ec1d34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba119 expref: 7 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707500.383846:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa06897400) 00010000:00010000:3.0:1787707500.383849:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787707500.383854:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa013fc000, rc 0) 00000100:00100000:3.0:1787707500.383955:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+7:13950:x1874546707774976:12345-192.168.204.46@tcp:101:mkdir.0 Request processed in 687us (3177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707500.383963:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 14 00010000:00010000:3.0:1787707500.408850:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787707500.549022:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b9f4cba3-9e74-47aa-919e-a4582dd7e4ec 00000001:00100000:0.0:1787707500.549350:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f288ac8a-880e-4537-b6b8-0ab57669b2f5 00000040:00080000:0.0:1787707500.793323:0:14460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787707501.434661:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707501.880748:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729791488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787707501.880848:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707501.880980:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729791488 00000100:00100000:2.0:1787707501.880991:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729791488 00000100:00100000:2.0:1787707501.881082:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787707501.881095:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729791488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787707501.881142:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707501.881199:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729791488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707501.881207:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1787707501.881266:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787707501.881302:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787707501.881329:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729791488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787707501.884652:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729791744:0@lo:400:kworker.0 00000100:00100000:1.0:1787707501.884756:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707501.884812:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787707501.884819:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a4807cb1-ea3f-4016-a232-153195075fb5:3315:1874546729791616:0@lo:400:kworker.0 00000100:00100000:1.0:1787707501.884853:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707501.885445:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729791872:0@lo:400:kworker.0 00000100:00100000:2.0:1787707501.885494:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707501.887588:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729791616 00000100:00100000:3.0:1787707501.887612:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729791616 00000100:00100000:3.0:1787707501.887708:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787707501.887722:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+19:3315:x1874546729791616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707501.887837:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+19:3315:x1874546729791616:12345-0@lo:400:kworker.0 Request processed in 118us (2982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707501.887845:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787707501.892315:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729791744 00000100:00100000:3.0:1787707501.892338:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729791744 00000100:00100000:3.0:1787707501.892462:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787707501.892480:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729791744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707501.892612:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729791744:12345-0@lo:400:kworker.0 Request processed in 140us (7856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707501.892620:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787707501.894264:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729792000:0@lo:400:kworker.0 00000100:00100000:3.0:1787707501.894352:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707501.894948:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729791872 00000100:00100000:2.0:1787707501.894960:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729791872 00000100:00100000:2.0:1787707501.895043:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729792000 00000100:00100000:2.0:1787707501.895047:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729792000 00000100:00100000:2.0:1787707501.895082:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787707501.895095:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729791872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707501.895172:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874546729791872:12345-0@lo:400:kworker.0 Request processed in 80us (9677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707501.895180:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787707501.895200:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787707501.895234:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729792000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707501.895268:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874546729792000:12345-0@lo:400:kworker.0 Request processed in 36us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707501.895275:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787707501.896705:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a4807cb1-ea3f-4016-a232-153195075fb5:3315:1874546729791616:0@lo:400:kworker.0 00000100:00100000:1.0:1787707501.896758:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729792128:0@lo:400:kworker.0 00000100:00100000:1.0:1787707501.896830:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707501.896880:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729791744:0@lo:400:kworker.0 00000100:00100000:2.0:1787707501.898325:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729792128 00000100:00100000:2.0:1787707501.898341:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729792128 00000100:00100000:2.0:1787707501.898485:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787707501.898498:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729792128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707501.898618:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874546729792128:12345-0@lo:400:kworker.0 Request processed in 122us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707501.898627:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787707501.899335:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874546729791872:0@lo:400:kworker.0 00000100:00080000:1.0:1787707501.905453:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787707501.905471:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787707501.905665:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874546729792000:0@lo:400:kworker.0 00000100:00100000:2.0:1787707501.908606:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874546729792128:0@lo:400:kworker.0 00000001:00100000:3.0:1787707501.972660:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f288ac8a-880e-4537-b6b8-0ab57669b2f5 00000001:00100000:3.0:1787707501.972685:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b9f4cba3-9e74-47aa-919e-a4582dd7e4ec 00010000:00010000:2.0:1787707502.457000:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787707502.499747:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f288ac8a-880e-4537-b6b8-0ab57669b2f5 00000001:00100000:2.0:1787707502.499771:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b9f4cba3-9e74-47aa-919e-a4582dd7e4ec 00010000:00010000:3.0:1787707503.493051:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787707503.866555:0:16399:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787707504.440883:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729792256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787707504.440997:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707504.441310:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729792256 00000100:00100000:2.0:1787707504.441321:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729792256 00000100:00100000:2.0:1787707504.441440:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787707504.441454:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729792256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787707504.441504:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707504.441567:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729792256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707504.441575:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787707504.441787:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787707504.442923:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729792256:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787707504.504664:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787707505.528685:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707505.543728:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707505.543777:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707505.543802:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707505.543827:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707505.543855:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707505.543874:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707505.543898:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707505.543923:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707775232 00000100:00100000:1.0:1787707505.543948:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707775232 00000100:00100000:1.0:1787707505.544016:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707775616 00000100:00100000:1.0:1787707505.544020:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707775616 00000100:00100000:1.0:1787707505.544046:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 20 00000100:00100000:1.0:1787707505.544057:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+6:2361:x1874546707775232:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707505.544128:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+6:2361:x1874546707775232:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 74us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707505.544135:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 20 00000100:00100000:1.0:1787707505.544154:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 21 00000100:00100000:1.0:1787707505.544161:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+6:2361:x1874546707775616:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707505.544184:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+6:2361:x1874546707775616:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 24us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707505.544190:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 21 00000100:00080000:1.0:1787707505.544207:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707505.544440:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707775488 00000100:00100000:0.0:1787707505.544445:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707775488 00000100:00100000:0.0:1787707505.544475:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707775744 00000100:00100000:0.0:1787707505.544479:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707775744 00000100:00100000:0.0:1787707505.544491:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707775360 00000100:00100000:0.0:1787707505.544493:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707775360 00000100:00100000:0.0:1787707505.544504:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707775872 00000100:00100000:0.0:1787707505.544506:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707775872 00000100:00100000:0.0:1787707505.544520:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 6 00000100:00100000:0.0:1787707505.544538:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+5:2361:x1874546707775488:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707505.544573:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+5:2361:x1874546707775488:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 37us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707505.544579:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 6 00000100:00100000:0.0:1787707505.544592:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 7 00000100:00100000:0.0:1787707505.544598:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+5:2361:x1874546707775744:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707505.544620:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+5:2361:x1874546707775744:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 22us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707505.544626:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 7 00000100:00100000:0.0:1787707505.544636:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 8 00000100:00100000:0.0:1787707505.544641:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+5:2361:x1874546707775360:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707505.544661:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+5:2361:x1874546707775360:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 19us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707505.544667:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 8 00000100:00100000:0.0:1787707505.544677:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 9 00000100:00100000:0.0:1787707505.544682:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+5:2361:x1874546707775872:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707505.544701:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+5:2361:x1874546707775872:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 19us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707505.544706:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 9 00000100:00080000:0.0:1787707505.544776:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787707505.544779:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787707505.544896:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707775104 00000100:00100000:3.0:1787707505.544901:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707775104 00000100:00100000:3.0:1787707505.544946:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 106 00000100:00100000:3.0:1787707505.544966:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+13:2361:x1874546707775104:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707505.545002:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+13:2361:x1874546707775104:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 49us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707505.545008:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 106 00010000:00010000:0.0:1787707506.553940:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707507.004827:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a4807cb1-ea3f-4016-a232-153195075fb5:3316:1874546729792384:0@lo:400:kworker.0 00000100:00100000:3.0:1787707507.004878:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729792512:0@lo:400:kworker.0 00000100:00100000:3.0:1787707507.005007:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707507.005080:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874546729793024:0@lo:400:kworker.0 00000100:00100000:3.0:1787707507.005114:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707507.005167:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729792512 00000100:00100000:3.0:1787707507.005179:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729792512 00000100:00100000:1.0:1787707507.005250:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707507.005275:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787707507.005290:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729792512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707507.005308:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729792896:0@lo:400:kworker.0 00000100:00100000:1.0:1787707507.005344:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707507.007171:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729792640:0@lo:400:kworker.0 00000100:00100000:1.0:1787707507.007234:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707507.007263:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787707507.007269:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729792768:0@lo:400:kworker.0 00000100:00100000:1.0:1787707507.007294:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707507.007328:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729793024 00000100:00100000:1.0:1787707507.007336:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729793024 00000100:00100000:1.0:1787707507.007402:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729792896 00000100:00100000:1.0:1787707507.007406:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729792896 00000100:00100000:1.0:1787707507.007421:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729792768 00000100:00100000:1.0:1787707507.007424:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729792768 00000100:00100000:1.0:1787707507.007454:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787707507.007463:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874546729793024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707507.007518:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874546729793024:12345-0@lo:400:kworker.0 Request processed in 55us (2401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707507.007525:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787707507.007543:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787707507.007549:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729792896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707507.007582:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729792896:12345-0@lo:400:kworker.0 Request processed in 33us (2238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707507.007588:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787707507.007600:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787707507.007606:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729792768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707507.007805:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729792768:12345-0@lo:400:kworker.0 Request processed in 198us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707507.007811:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787707507.007833:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729792384 00000100:00100000:1.0:1787707507.007837:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729792384 00000100:00100000:1.0:1787707507.007865:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787707507.007872:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+19:3316:x1874546729792384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707507.007902:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+19:3316:x1874546729792384:12345-0@lo:400:kworker.0 Request processed in 31us (2655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707507.007908:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787707507.008027:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729792640 00000100:00100000:1.0:1787707507.008032:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729792640 00000100:00100000:1.0:1787707507.008060:0:15113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787707507.008066:0:15113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729792640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707507.008099:0:15113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729792640:12345-0@lo:400:kworker.0 Request processed in 33us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707507.008105:0:15113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787707507.008145:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a4807cb1-ea3f-4016-a232-153195075fb5:3316:1874546729792384:0@lo:400:kworker.0 00000100:00100000:1.0:1787707507.008159:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729792896:0@lo:400:kworker.0 00000100:00100000:1.0:1787707507.008189:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729792768:0@lo:400:kworker.0 00000100:00100000:1.0:1787707507.008199:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729792640:0@lo:400:kworker.0 00000100:00100000:3.0:1787707507.010196:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729792512:12345-0@lo:400:kworker.0 Request processed in 4896us (5177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707507.010219:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787707507.010421:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787707507.010430:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787707507.010435:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787707507.010510:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729792512:0@lo:400:kworker.0 00000100:00100000:3.0:1787707507.010531:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874546729793024:0@lo:400:kworker.0 00000100:00100000:0.0:1787707507.012146:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729793152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787707507.012219:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707507.012287:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729793152 00000100:00100000:0.0:1787707507.012294:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729793152 00000100:00100000:0.0:1787707507.012342:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787707507.012351:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729793152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787707507.012505:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707507.015300:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729793152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2940us (3071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707507.015314:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787707507.016214:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729793152:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787707507.578513:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787707508.571968:0:16547:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe01e22330 20000000:00000080:2.0:1787707508.571994:0:16547:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cf902c99000 uarg=0000000000000000 20000000:01000000:2.0:1787707508.572043:0:16547:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787707508.572051:0:16547:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787707508.572058:0:16547:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787707508.573825:0:16548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1787707508.574054:0:16547:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787707508.585142:0:16547:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787707508.585189:0:16547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfa0871a800/0xc5f18d5f94ec1d3b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707508.585214:0:16547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa3f8dac00/0xc5f18d5f94ec1a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1a2b expref: 18 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707508.585223:0:16547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa0871aa00/0xc5f18d5f94ec1a7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1a78 expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707508.585231:0:16547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa41a14200/0xc5f18d5f94ec1bb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1bac expref: 18 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707508.585242:0:16547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1cd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba08d expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707508.585250:0:16547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec1d11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba0ef expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707508.586047:0:16547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfa0871a800/0xc5f18d5f94ec1d3b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707508.586118:0:16547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec1d11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba0ef expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707508.586152:0:16547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec1d11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba0ef expref: 12 pid: 14424 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707508.586173:0:16547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f155f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16547:1874546729793280:192.168.204.46@tcp:104: 00010000:00010000:3.0:1787707508.587593:0:16547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1cd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba08d expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707508.587640:0:16547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1cd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba08d expref: 12 pid: 14424 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707508.587657:0:16547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac51c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16547:1874546729793408:192.168.204.46@tcp:104: 00010000:00010000:3.0:1787707508.587793:0:16547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa41a14200/0xc5f18d5f94ec1bb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec1bac expref: 18 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707508.587801:0:16547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfa41a14200/0xc5f18d5f94ec1bb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec1bac expref: 18 pid: 14422 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707508.587812:0:16547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac50a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16547:1874546729793536:0@lo:104: 00000100:00100000:3.0:1787707508.587859:0:16547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787707508.587907:0:16547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa0871aa00/0xc5f18d5f94ec1a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec1a78 expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707508.587915:0:16547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfa0871aa00/0xc5f18d5f94ec1a7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec1a78 expref: 18 pid: 14424 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707508.587924:0:16547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac53b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16547:1874546729793664:0@lo:104: 00000100:00100000:3.0:1787707508.587945:0:16547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787707508.587976:0:16547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfa3f8dac00/0xc5f18d5f94ec1a32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f18d5f94ec1a2b expref: 18 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707508.587986:0:16547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfa3f8dac00/0xc5f18d5f94ec1a32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f18d5f94ec1a2b expref: 18 pid: 14423 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707508.587995:0:16547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac52300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16547:1874546729793792:0@lo:104: 00000100:00100000:3.0:1787707508.588022:0:16547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707508.588042:0:16547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa06fa7540 going to sleep for 11 seconds 00000100:00100000:1.0:1787707508.588552:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787707508.588570:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729793536 00000100:00100000:1.0:1787707508.588579:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729793536 00000100:00100000:1.0:1787707508.588644:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729793664 00000100:00100000:1.0:1787707508.588655:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729793664 00000100:00100000:1.0:1787707508.588669:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729793792 00000100:00100000:1.0:1787707508.588672:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729793792 00000100:00100000:1.0:1787707508.588685:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787707508.588695:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a4807cb1-ea3f-4016-a232-153195075fb5+5:16547:x1874546729793536:12345-0@lo:104: 00010000:00010000:1.0:1787707508.588710:0:14413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa0871be00/0xc5f18d5f94ec1bac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec1bb3 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707508.588939:0:14413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787707508.588947:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a4807cb1-ea3f-4016-a232-153195075fb5+5:16547:x1874546729793536:12345-0@lo:104: Request processed in 252us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707508.588955:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787707508.588977:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787707508.588984:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a4807cb1-ea3f-4016-a232-153195075fb5+4:16547:x1874546729793664:12345-0@lo:104: 00010000:00010000:1.0:1787707508.588992:0:14413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14600/0xc5f18d5f94ec1a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec1a7f expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707508.589034:0:14413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787707508.589039:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a4807cb1-ea3f-4016-a232-153195075fb5+4:16547:x1874546729793664:12345-0@lo:104: Request processed in 57us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707508.589045:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787707508.589057:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787707508.589063:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa059a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a4807cb1-ea3f-4016-a232-153195075fb5+3:16547:x1874546729793792:12345-0@lo:104: 00010000:00010000:1.0:1787707508.589070:0:14413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec1a2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec1a32 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707508.589105:0:14413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787707508.589110:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa059a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a4807cb1-ea3f-4016-a232-153195075fb5+3:16547:x1874546729793792:12345-0@lo:104: Request processed in 48us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707508.589122:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787707508.589176:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787707508.589183:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa0871be00/0xc5f18d5f94ec1bac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec1bb3 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707508.589197:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871be00 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:1.0:1787707508.589202:0:14417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa0871be00/0xc5f18d5f94ec1bac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec1bb3 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707508.589211:0:14417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa0871be00/0xc5f18d5f94ec1bac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec1bb3 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787707508.589220:0:14417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa0871be00/0xc5f18d5f94ec1bac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec1bb3 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707508.589226:0:14417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787707508.589328:0:14417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa0871be00/0xc5f18d5f94ec1bac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec1bb3 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707508.589336:0:14417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787707508.589365:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa0871be00/0xc5f18d5f94ec1bac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec1bb3 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707508.589416:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa0871be00/0xc5f18d5f94ec1bac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec1bb3 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707508.589433:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787707508.589437:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14600/0xc5f18d5f94ec1a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec1a7f expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707508.589453:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14600 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:1.0:1787707508.589456:0:14417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14600/0xc5f18d5f94ec1a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec1a7f expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707508.589461:0:14417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14600/0xc5f18d5f94ec1a78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec1a7f expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787707508.589467:0:14417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14600/0xc5f18d5f94ec1a78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec1a7f expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707508.589471:0:14417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787707508.589486:0:14417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14600/0xc5f18d5f94ec1a78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec1a7f expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707508.589492:0:14417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787707508.589722:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14600/0xc5f18d5f94ec1a78 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec1a7f expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707508.589731:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa41a14600/0xc5f18d5f94ec1a78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec1a7f expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707508.589742:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787707508.589745:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec1a2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f18d5f94ec1a32 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707508.589751:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fdc00 already unused, calling callback (ffffffffc1c4dc20) 10000000:00010000:1.0:1787707508.589754:0:14417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec1a2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f18d5f94ec1a32 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707508.589771:0:14417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec1a2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f18d5f94ec1a32 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707508.589956:0:16547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac50a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16547:1874546729793536:0@lo:104: 00000100:00100000:3.0:1787707508.589969:0:16547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac53b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16547:1874546729793664:0@lo:104: 00000100:00100000:3.0:1787707508.589978:0:16547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac52300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16547:1874546729793792:0@lo:104: 10000000:00010000:1.0:1787707508.590028:0:14417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec1a2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f18d5f94ec1a32 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707508.590033:0:14417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787707508.590053:0:14417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec1a2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec1a32 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707508.590059:0:14417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787707508.590066:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec1a2b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec1a32 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707508.590072:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.146@tcp lock: ffff8cfa421fdc00/0xc5f18d5f94ec1a2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f18d5f94ec1a32 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707508.590091:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707508.590094:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707508.590095:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787707508.590105:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707508.590115:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787707508.590132:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a4807cb1-ea3f-4016-a232-153195075fb5:3314:1874546729793920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787707508.590185:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707508.590300:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a4807cb1-ea3f-4016-a232-153195075fb5:3316:1874546729794048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787707508.590327:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707508.590366:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a4807cb1-ea3f-4016-a232-153195075fb5:3317:1874546729794176:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787707508.590683:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787707508.591453:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707508.591675:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729793920 00000100:00100000:3.0:1787707508.591688:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729793920 00010000:00010000:3.0:1787707508.591730:0:14415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa41a14200/0xc5f18d5f94ec1bb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec1bac expref: 19 pid: 14422 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707508.591766:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729794048 00000100:00100000:3.0:1787707508.591770:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729794048 00010000:00010000:3.0:1787707508.591795:0:14415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa0871aa00/0xc5f18d5f94ec1a7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec1a78 expref: 20 pid: 14424 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707508.591811:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787707508.591821:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4807cb1-ea3f-4016-a232-153195075fb5+20:3314:x1874546729793920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787707508.591838:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707508.591845:0:14415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa41a14200/0xc5f18d5f94ec1bb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec1bac expref: 20 pid: 14422 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707508.591859:0:14415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa41a14200/0xc5f18d5f94ec1bb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec1bac expref: 20 pid: 14422 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707508.591880:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa41a14200/0xc5f18d5f94ec1bb3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec1bac expref: 20 pid: 14422 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707508.591913:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707508.591973:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4807cb1-ea3f-4016-a232-153195075fb5+19:3314:x1874546729793920:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (1788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707508.591981:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787707508.592016:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787707508.592022:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4807cb1-ea3f-4016-a232-153195075fb5+18:3316:x1874546729794048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787707508.592033:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707508.592037:0:14415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa0871aa00/0xc5f18d5f94ec1a7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec1a78 expref: 18 pid: 14424 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707508.592047:0:14415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa0871aa00/0xc5f18d5f94ec1a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec1a78 expref: 18 pid: 14424 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707508.592058:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa0871aa00/0xc5f18d5f94ec1a7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec1a78 expref: 18 pid: 14424 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707508.592068:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707508.592098:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4807cb1-ea3f-4016-a232-153195075fb5+17:3316:x1874546729794048:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707508.592104:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787707508.592750:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a4807cb1-ea3f-4016-a232-153195075fb5:3316:1874546729794048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787707508.592815:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a4807cb1-ea3f-4016-a232-153195075fb5:3314:1874546729793920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787707508.592970:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729794176 00000100:00100000:0.0:1787707508.592977:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729794176 00010000:00010000:0.0:1787707508.593006:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa3f8dac00/0xc5f18d5f94ec1a32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec1a2b expref: 17 pid: 14423 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707508.593051:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787707508.593061:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f9b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4807cb1-ea3f-4016-a232-153195075fb5+17:3317:x1874546729794176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787707508.593073:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707508.593078:0:14415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa3f8dac00/0xc5f18d5f94ec1a32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f18d5f94ec1a2b expref: 17 pid: 14423 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707508.593087:0:14415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa3f8dac00/0xc5f18d5f94ec1a32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f18d5f94ec1a2b expref: 17 pid: 14423 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707508.593103:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa3f8dac00/0xc5f18d5f94ec1a32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f18d5f94ec1a2b expref: 17 pid: 14423 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707508.593115:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707508.593172:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f9b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4807cb1-ea3f-4016-a232-153195075fb5+16:3317:x1874546729794176:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707508.593180:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787707508.593331:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a4807cb1-ea3f-4016-a232-153195075fb5:3317:1874546729794176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787707508.599672:0:16547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f155f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16547:1874546729793280:192.168.204.46@tcp:104: 00000100:00100000:3.0:1787707508.599695:0:16547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac51c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16547:1874546729793408:192.168.204.46@tcp:104: 00010000:00010000:3.0:1787707508.599748:0:16547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfa0871a800/0xc5f18d5f94ec1d3b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707508.600991:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707508.602992:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707508.603110:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707508.603347:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707776000 00000100:00100000:0.0:1787707508.603362:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707776000 00010000:00010000:0.0:1787707508.603445:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec1d11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba0ef expref: 13 pid: 14424 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707508.603482:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707776128 00000100:00100000:0.0:1787707508.603488:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707776128 00010000:00010000:0.0:1787707508.603516:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1cd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba08d expref: 14 pid: 14424 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707508.603535:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 7 00000100:00100000:0.0:1787707508.603547:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+14:2361:x1874546707776000:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707508.603568:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707508.603575:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec1d11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba0ef expref: 14 pid: 14424 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707508.603613:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec1d11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba0ef expref: 14 pid: 14424 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707508.603647:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa013fc600/0xc5f18d5f94ec1d11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba0ef expref: 14 pid: 14424 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707508.603673:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707508.603750:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+13:2361:x1874546707776000:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 205us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707508.603758:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 7 00000100:00100000:0.0:1787707508.603783:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 8 00000100:00100000:0.0:1787707508.603790:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+12:2362:x1874546707776128:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707508.603798:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707508.603802:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1cd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba08d expref: 12 pid: 14424 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707508.603811:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1cd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba08d expref: 12 pid: 14424 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707508.603820:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1cd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba08d expref: 12 pid: 14424 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707508.603834:0:14416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfa0871a800/0xc5f18d5f94ec1d3b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707508.603845:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa0871a800/0xc5f18d5f94ec1d3b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707508.603876:0:14416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa0871a800/0xc5f18d5f94ec1d3b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707508.603884:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfa0871a800/0xc5f18d5f94ec1d3b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707508.603891:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfa0871a800/0xc5f18d5f94ec1d3b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707508.603910:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfa0871a800/0xc5f18d5f94ec1d3b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707508.603917:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871a800 already unused, calling callback (ffffffffc1630230) 00010000:00010000:0.0:1787707508.603922:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfa0871a800/0xc5f18d5f94ec1d3b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707508.603932:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfa0871a800/0xc5f18d5f94ec1d3b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707508.603955:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfa0871a800/0xc5f18d5f94ec1d3b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707508.603968:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787707508.603991:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+11:2362:x1874546707776128:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 200us (881us total) trans 0 rc 0/0 00010000:00010000:1.0:1787707508.603994:0:16547:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfa0871a800/0xc5f18d5f94ec1d3b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707508.603998:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 8 00010000:00010000:1.0:1787707508.604004:0:16547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfa0871a800/0xc5f18d5f94ec1d3b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707508.604011:0:16547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfa0871a800/0xc5f18d5f94ec1d3b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707509.573231:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787707509.573253:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729794304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787707509.573324:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707509.573501:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729794304 00000100:00100000:2.0:1787707509.573510:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729794304 00000100:00100000:2.0:1787707509.573578:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787707509.573590:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729794304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787707509.573630:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707509.573680:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729794304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707509.573688:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787707509.573735:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729794304:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787707509.573847:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787707509.624533:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787707509.816453:0:14426:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787707509.816461:0:14426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfa3acd9800 from 10 10000000:01000000:0.0:1787707509.816466:0:14426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787707509.816515:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec1d42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707509.816532:0:14426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec1d42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707509.816544:0:14426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec1d42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707509.816571:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729794432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787707509.816644:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707509.816699:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07397a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787707509.816751:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729794432 00000100:00100000:3.0:1787707509.816760:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729794432 00000100:00100000:3.0:1787707509.816829:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787707509.816838:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+16:14426:x1874546729794432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787707509.816851:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707509.816863:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa013fdc00/0xc5f18d5f94ec1d49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec1d42 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707509.816896:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa013fdc00/0xc5f18d5f94ec1d49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1d42 expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707509.816909:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa013fdc00/0xc5f18d5f94ec1d49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1d42 expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707509.816918:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa013fdc00, rc 0) 00000100:00100000:3.0:1787707509.816967:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+17:14426:x1874546729794432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707509.816974:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787707509.817189:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729794432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787707509.817207:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec1d42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1d49 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707509.817216:0:14426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec1d42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec1d49 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707509.817271:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729794560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787707509.817297:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707509.817321:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07397a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787707509.817367:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729794560 00000100:00100000:3.0:1787707509.817396:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729794560 00000100:00100000:3.0:1787707509.817422:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787707509.817429:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+17:14426:x1874546729794560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787707509.817681:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+17:14426:x1874546729794560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707509.817688:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787707509.817761:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729794560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787707509.817802:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729794688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787707509.817836:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707509.817858:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07397a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787707509.818063:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729794688 00000100:00100000:3.0:1787707509.818068:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729794688 00000100:00100000:3.0:1787707509.818097:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787707509.818104:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+17:14426:x1874546729794688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787707509.818241:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+17:14426:x1874546729794688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707509.818248:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787707509.818283:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729794688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787707509.819743:0:16594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787707509.821397:0:14426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787707509.821437:0:14426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787707509.821449:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec1d42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1d49 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707509.821462:0:14426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa3fcd3400/0xc5f18d5f94ec1d42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1d49 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787707509.821474:0:14426:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787707509.821478:0:14426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfa359ee800 from 10 10000000:01000000:2.0:1787707509.821481:0:14426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787707509.821521:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa0871aa00/0xc5f18d5f94ec1d50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707509.821535:0:14426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa0871aa00/0xc5f18d5f94ec1d50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707509.821550:0:14426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa0871aa00/0xc5f18d5f94ec1d50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707509.821582:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa2f155f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729794816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787707509.821652:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707509.821691:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa065b39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787707509.821857:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729794816 00000100:00100000:1.0:1787707509.821865:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729794816 00000100:00100000:0.0:1787707509.828826:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787707509.828842:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+17:14426:x1874546729794816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787707509.828866:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707509.828897:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1d57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec1d50 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707509.828929:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1d57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1d50 expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707509.828940:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa3fcd2200/0xc5f18d5f94ec1d57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1d50 expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707509.828950:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2200, rc 0) 00000100:00100000:0.0:1787707509.829040:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+18:14426:x1874546729794816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (7387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707509.829048:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787707509.829083:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa2f155f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729794816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787707509.829101:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa0871aa00/0xc5f18d5f94ec1d50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1d57 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707509.829111:0:14426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa0871aa00/0xc5f18d5f94ec1d50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec1d57 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707509.829179:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729794944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787707509.829212:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707509.829244:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa35b186c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707509.829325:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729794944 00000100:00100000:0.0:1787707509.829332:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729794944 00000100:00100000:0.0:1787707509.829364:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787707509.829392:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+18:14426:x1874546729794944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787707509.829691:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+18:14426:x1874546729794944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 320us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707509.829709:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787707509.829896:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729794944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787707509.829929:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729795072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787707509.829966:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707509.830007:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa103cd480 going to sleep for 11 seconds 00000100:00100000:1.0:1787707509.830491:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729795072 00000100:00100000:1.0:1787707509.830497:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729795072 00000100:00100000:1.0:1787707509.830529:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787707509.830537:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+18:14426:x1874546729795072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787707509.830702:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+18:14426:x1874546729795072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707509.830710:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787707509.833211:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729795072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787707509.834191:0:16598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787707509.834335:0:14426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787707509.834354:0:14426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787707509.834366:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa0871aa00/0xc5f18d5f94ec1d50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1d57 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707509.834408:0:14426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa0871aa00/0xc5f18d5f94ec1d50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1d57 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787707509.834420:0:14426:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787707509.834422:0:14426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfa2a55f000 from 10 10000000:01000000:1.0:1787707509.834425:0:14426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787707509.834464:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5600/0xc5f18d5f94ec1d5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707509.834471:0:14426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5600/0xc5f18d5f94ec1d5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707509.834481:0:14426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5600/0xc5f18d5f94ec1d5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707509.834507:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729795200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787707509.834587:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707509.834628:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa2f25ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787707509.834692:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729795200 00000100:00100000:3.0:1787707509.834699:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729795200 00000100:00100000:3.0:1787707509.834746:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787707509.834756:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+18:14426:x1874546729795200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787707509.834768:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707509.834781:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa013fde00/0xc5f18d5f94ec1d65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f18d5f94ec1d5e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707509.834811:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa013fde00/0xc5f18d5f94ec1d65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1d5e expref: 19 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707509.834821:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa013fde00/0xc5f18d5f94ec1d65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f18d5f94ec1d5e expref: 19 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707509.834830:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa013fde00, rc 0) 00000100:00100000:3.0:1787707509.834885:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+19:14426:x1874546729795200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707509.834892:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787707509.834936:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729795200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787707509.834950:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5600/0xc5f18d5f94ec1d5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1d65 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707509.834958:0:14426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5600/0xc5f18d5f94ec1d5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f18d5f94ec1d65 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707509.835003:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729795328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787707509.835027:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707509.835042:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa41fe0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787707509.835055:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729795328 00000100:00100000:3.0:1787707509.835058:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729795328 00000100:00100000:3.0:1787707509.835080:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787707509.835086:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+19:14426:x1874546729795328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787707509.835314:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+19:14426:x1874546729795328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707509.835330:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787707509.835362:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729795328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787707509.835413:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729795456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787707509.835447:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707509.835460:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07397a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787707509.835471:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729795456 00000100:00100000:3.0:1787707509.835474:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729795456 00000100:00100000:3.0:1787707509.835493:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787707509.835500:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+19:14426:x1874546729795456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787707509.835631:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4807cb1-ea3f-4016-a232-153195075fb5+19:14426:x1874546729795456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707509.835638:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787707509.835671:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a4807cb1-ea3f-4016-a232-153195075fb5:14426:1874546729795456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787707509.839233:0:16599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787707509.842359:0:14426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787707509.842411:0:14426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787707509.842423:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5600/0xc5f18d5f94ec1d5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1d65 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707509.842437:0:14426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.146@tcp lock: ffff8cfa029d5600/0xc5f18d5f94ec1d5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f18d5f94ec1d65 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707509.893294:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707509.893353:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707776256 00000100:00100000:3.0:1787707509.893364:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707776256 00000100:00100000:3.0:1787707509.893441:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 117 00000100:00100000:3.0:1787707509.893451:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+11:13804:x1874546707776256:12345-192.168.204.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787707509.893485:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707509.893505:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa013fca00/0xc5f18d5f94ec1d6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba120 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707509.893535:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa013fca00/0xc5f18d5f94ec1d6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba120 expref: 12 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707509.893546:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa013fca00/0xc5f18d5f94ec1d6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba120 expref: 12 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707509.893556:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa013fca00, rc 0) 00000100:00100000:3.0:1787707509.893645:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+12:13804:x1874546707776256:12345-192.168.204.46@tcp:101:ll_cfg_requeue.0 Request processed in 195us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707509.893652:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 117 00000100:00100000:3.0:1787707509.909623:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707509.909741:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707776384 00000100:00100000:2.0:1787707509.909761:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707776384 00000100:00100000:2.0:1787707509.909823:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 118 00000100:00100000:2.0:1787707509.909835:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+12:13804:x1874546707776384:12345-192.168.204.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787707509.910266:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+12:13804:x1874546707776384:12345-192.168.204.46@tcp:501:ll_cfg_requeue.0 Request processed in 431us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707509.910276:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 118 00000100:00100000:2.0:1787707509.918862:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707509.918986:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707776512 00000100:00100000:3.0:1787707509.918997:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707776512 00000100:00100000:3.0:1787707509.919059:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 119 00000100:00100000:3.0:1787707509.919070:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+12:13804:x1874546707776512:12345-192.168.204.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787707509.919294:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+12:13804:x1874546707776512:12345-192.168.204.46@tcp:503:ll_cfg_requeue.0 Request processed in 225us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707509.919302:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 119 00000100:00100000:0.0:1787707509.937320:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707509.938102:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707776640 00000100:00100000:1.0:1787707509.938115:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707776640 00000100:00100000:1.0:1787707509.938183:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 120 00000100:00100000:1.0:1787707509.938193:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+12:13804:x1874546707776640:12345-192.168.204.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787707509.938220:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707509.938240:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec1d73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba127 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707509.938270:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec1d73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba127 expref: 13 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707509.938281:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfa029d5e00/0xc5f18d5f94ec1d73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba127 expref: 13 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707509.938290:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d5e00, rc 0) 00000100:00100000:1.0:1787707509.938355:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+13:13804:x1874546707776640:12345-192.168.204.46@tcp:101:ll_cfg_requeue.0 Request processed in 163us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707509.938363:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 120 00000100:00100000:3.0:1787707509.953608:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707509.955285:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707776768 00000100:00100000:0.0:1787707509.955298:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707776768 00000100:00100000:0.0:1787707509.955360:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 121 00000100:00100000:0.0:1787707509.955394:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+13:13804:x1874546707776768:12345-192.168.204.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787707509.955693:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+13:13804:x1874546707776768:12345-192.168.204.46@tcp:501:ll_cfg_requeue.0 Request processed in 322us (2094us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707509.955702:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 121 00000100:00100000:0.0:1787707509.958539:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707509.958645:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707776896 00000100:00100000:1.0:1787707509.958655:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707776896 00000100:00100000:1.0:1787707509.958715:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 122 00000100:00100000:1.0:1787707509.958727:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+13:13804:x1874546707776896:12345-192.168.204.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787707509.958964:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+13:13804:x1874546707776896:12345-192.168.204.46@tcp:503:ll_cfg_requeue.0 Request processed in 238us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707509.958982:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 122 00000040:00080000:0.0:1787707510.013115:0:14460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787707510.648585:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707510.658883:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707510.658926:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707510.658961:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707510.659002:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707510.659030:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707510.659056:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707510.659079:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707510.659116:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707777408 00000100:00100000:0.0:1787707510.659116:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707777664 00000100:00100000:3.0:1787707510.659127:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707777408 00000100:00100000:0.0:1787707510.659127:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707777664 00000100:00100000:2.0:1787707510.659201:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707777280 00000100:00100000:2.0:1787707510.659206:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707777280 00000100:00100000:3.0:1787707510.659207:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707777792 00000100:00100000:3.0:1787707510.659212:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707777792 00000100:00100000:1.0:1787707510.659265:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707777152 00000100:00100000:1.0:1787707510.659270:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707777152 00000100:00100000:0.0:1787707510.661682:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 12 00000100:00100000:0.0:1787707510.661703:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+5:2359:x1874546707777408:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707510.661805:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+5:2359:x1874546707777408:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 110us (2877us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707510.661813:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 12 00000100:00100000:0.0:1787707510.661833:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 13 00000100:00100000:0.0:1787707510.661841:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+5:2359:x1874546707777664:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707510.661880:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+5:2359:x1874546707777664:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 40us (2918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707510.661904:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 13 00000100:00100000:0.0:1787707510.661936:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707777536 00000100:00100000:0.0:1787707510.661943:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707777536 00000100:00100000:0.0:1787707510.661984:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 25 00000100:00100000:0.0:1787707510.661991:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+6:2359:x1874546707777536:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:0.0:1787707510.662036:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+6:2359:x1874546707777536:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 45us (2979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707510.662043:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 25 00000100:00100000:2.0:1787707510.667753:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 14 00000100:00100000:2.0:1787707510.667768:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+5:2359:x1874546707777280:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:2.0:1787707510.667865:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+5:2359:x1874546707777280:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 89us (8821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707510.667874:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 14 00000100:00100000:1.0:1787707510.676153:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 26 00000100:00100000:1.0:1787707510.676172:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+6:2359:x1874546707777152:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707510.676262:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+6:2359:x1874546707777152:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 97us (17389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707510.676270:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 26 00000100:00080000:2.0:1787707510.679666:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787707510.679680:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787707510.679684:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787707510.679707:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707777024 00000100:00100000:2.0:1787707510.679718:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707777024 00000100:00100000:3.0:1787707510.680423:0:15113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 15 00000100:00100000:3.0:1787707510.680437:0:15113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+5:2359:x1874546707777792:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:3.0:1787707510.680515:0:15113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+5:2359:x1874546707777792:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 82us (21434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707510.680522:0:15113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 15 00000100:00100000:1.0:1787707510.683547:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 123 00000100:00100000:1.0:1787707510.683575:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+13:2359:x1874546707777024:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707510.683682:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+13:2359:x1874546707777024:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 120us (24678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707510.688089:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 123 00010000:00010000:1.0:1787707511.672687:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707512.120853:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729795840:0@lo:400:kworker.0 00000100:00100000:0.0:1787707512.120927:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707512.120991:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787707512.120998:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729795712:0@lo:400:kworker.0 00000100:00100000:0.0:1787707512.121021:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707512.121038:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874546729796224:0@lo:400:kworker.0 00000100:00100000:0.0:1787707512.121059:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707512.121089:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729795840 00000100:00100000:0.0:1787707512.121096:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729795840 00000100:00100000:0.0:1787707512.121149:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729795712 00000100:00100000:0.0:1787707512.121152:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729795712 00000100:00100000:0.0:1787707512.121176:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787707512.121186:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729795840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707512.121242:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729795840:12345-0@lo:400:kworker.0 Request processed in 57us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707512.121249:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787707512.121265:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787707512.121285:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729795712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707512.121317:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874546729795712:12345-0@lo:400:kworker.0 Request processed in 32us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707512.121323:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787707512.121345:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729796224 00000100:00100000:0.0:1787707512.121349:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729796224 00000100:00100000:0.0:1787707512.121400:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787707512.121407:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874546729796224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707512.121436:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874546729796224:12345-0@lo:400:kworker.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707512.121441:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1787707512.121457:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787707512.121461:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787707512.121463:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787707512.121491:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729795712:0@lo:400:kworker.0 00000100:00100000:0.0:1787707512.121501:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874546729796224:0@lo:400:kworker.0 00000100:00100000:0.0:1787707512.121508:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874546729795840:0@lo:400:kworker.0 00000100:00100000:3.0:1787707512.121663:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729795968:0@lo:400:kworker.0 00000100:00100000:3.0:1787707512.121695:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707512.121731:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787707512.121737:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a4807cb1-ea3f-4016-a232-153195075fb5:3314:1874546729795584:0@lo:400:kworker.0 00000100:00100000:3.0:1787707512.121763:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707512.121788:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729796096:0@lo:400:kworker.0 00000100:00100000:3.0:1787707512.121808:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707512.121847:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729795584 00000100:00100000:3.0:1787707512.121852:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729795584 00000100:00100000:3.0:1787707512.121878:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787707512.121885:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+19:3314:x1874546729795584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707512.121920:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4807cb1-ea3f-4016-a232-153195075fb5+19:3314:x1874546729795584:12345-0@lo:400:kworker.0 Request processed in 35us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707512.121927:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787707512.121958:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a4807cb1-ea3f-4016-a232-153195075fb5:3314:1874546729795584:0@lo:400:kworker.0 00000100:00100000:0.0:1787707512.122067:0:15848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729795968 00000100:00100000:0.0:1787707512.122072:0:15848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729795968 00000100:00100000:0.0:1787707512.122103:0:15848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729796096 00000100:00100000:0.0:1787707512.122106:0:15848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729796096 00000100:00100000:0.0:1787707512.122129:0:15848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787707512.122134:0:15848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729795968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707512.122170:0:15848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729795968:12345-0@lo:400:kworker.0 Request processed in 35us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707512.122176:0:15848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787707512.122198:0:15848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787707512.122204:0:15848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729796096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787707512.122233:0:15848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874546729796096:12345-0@lo:400:kworker.0 Request processed in 30us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707512.122238:0:15848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787707512.122252:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707512.122316:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874546729796096:0@lo:400:kworker.0 00000100:00100000:3.0:1787707512.122326:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729795968:0@lo:400:kworker.0 00000100:00100000:3.0:1787707512.123479:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787707512.130685:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa41c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729796352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787707512.130856:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707512.130985:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729796352 00000100:00100000:2.0:1787707512.130995:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729796352 00000100:00100000:2.0:1787707512.131052:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787707512.131061:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729796352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787707512.131102:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787707512.131155:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729796352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707512.131162:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787707512.131455:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa41c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729796352:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787707512.696540:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707512.797544:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707512.798119:0:15848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707777920 00000100:00100000:1.0:1787707512.798129:0:15848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707777920 00000100:00100000:1.0:1787707512.798243:0:15848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 15 00000100:00100000:1.0:1787707512.798254:0:15848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+6:14461:x1874546707777920:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787707512.798273:0:15848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707512.798292:0:15848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1d7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba12e expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.798363:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1d81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.798426:0:15848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1d81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.798436:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1d81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.798451:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1d88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.798457:0:15848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1d88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.798462:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1d88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.799347:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5800/0xc5f18d5f94ec1d8f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.799362:0:15848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5800/0xc5f18d5f94ec1d8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.799394:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5800/0xc5f18d5f94ec1d8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707512.799478:0:15848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787707512.799483:0:15848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787707512.799572:0:15848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5800/0xc5f18d5f94ec1d8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.799585:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1d81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.799602:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1d81 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.799609:0:15848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1d81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.799616:0:15848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707512.799620:0:15848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1d81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.799627:0:15848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1d81 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.799639:0:15848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa06897400) 00010000:00010000:1.0:1787707512.799642:0:15848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707512.799647:0:15848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1d81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.799652:0:15848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1d81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.799665:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1d88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.799671:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1d88 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.799676:0:15848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1d88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.799682:0:15848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4c00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707512.799690:0:15848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1d88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.799696:0:15848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1d88 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.799704:0:15848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cfa06897500) 00010000:00010000:1.0:1787707512.799706:0:15848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707512.799709:0:15848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1d88 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.800072:0:15848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1d88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.800115:0:15848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1d7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba12e expref: 8 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.800129:0:15848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5800/0xc5f18d5f94ec1d8f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba12e expref: 7 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.800137:0:15848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cfa06897a00) 00010000:00010000:1.0:1787707512.800139:0:15848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787707512.800142:0:15848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d5800, rc 0) 00000100:00100000:1.0:1787707512.800284:0:15848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+7:14461:x1874546707777920:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 2030us (2748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707512.800294:0:15848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 15 00000100:00080000:0.0:1787707512.806727:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787707512.822801:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707512.822954:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707778176 00000100:00100000:1.0:1787707512.822964:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707778176 00000100:00100000:1.0:1787707512.823037:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 16 00000100:00100000:1.0:1787707512.823049:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+7:14461:x1874546707778176:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787707512.823086:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707512.823109:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1d96 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba135 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.823187:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1d9d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.823201:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1d9d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.823211:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1d9d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.823263:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1da4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.823270:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1da4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.823277:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1da4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.824197:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4600/0xc5f18d5f94ec1dab lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.824214:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4600/0xc5f18d5f94ec1dab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.824224:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4600/0xc5f18d5f94ec1dab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707512.824237:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787707512.824517:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1d9d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.824525:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1d9d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.824532:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1d9d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.824538:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4c00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707512.824542:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1d9d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.824550:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1d9d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.824563:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cfa06897a00) 00010000:00010000:1.0:1787707512.824566:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707512.824570:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1d9d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.824576:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1d9d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.824589:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1da4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.824595:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1da4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.824601:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1da4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.824616:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707512.824619:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1da4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.824625:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1da4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.824634:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cfa06897500) 00010000:00010000:1.0:1787707512.824637:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707512.824639:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1da4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.824646:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1da4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.825229:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1d96 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba135 expref: 10 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.825245:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4600/0xc5f18d5f94ec1dab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba135 expref: 9 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.825253:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfa06897800) 00010000:00010000:1.0:1787707512.825255:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707512.825257:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d4600, rc 0) 00000100:00100000:1.0:1787707512.825611:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+9:14461:x1874546707778176:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 2562us (2822us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787707512.825621:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 16 00000100:00100000:3.0:1787707512.834310:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707512.838026:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707778304 00000100:00100000:0.0:1787707512.838042:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707778304 00000100:00100000:0.0:1787707512.838491:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 17 00000100:00100000:0.0:1787707512.838506:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+9:14461:x1874546707778304:12345-192.168.204.46@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787707512.838622:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+9:14461:x1874546707778304:12345-192.168.204.46@tcp:59:lhsmtool_posix.0 Request processed in 120us (4324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707512.838630:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 17 00000100:00100000:0.0:1787707512.907516:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707512.907623:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707778432 00000100:00100000:2.0:1787707512.907634:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707778432 00000100:00100000:2.0:1787707512.907708:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 18 00000100:00100000:2.0:1787707512.907718:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+9:14467:x1874546707778432:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:2.0:1787707512.907738:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707512.907760:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1db9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba13c expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.907836:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec1dc0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.907851:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec1dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.907863:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec1dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.907896:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1dc7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.907903:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.907909:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.908170:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec1dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.908179:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec1dc0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.908185:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec1dc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.908192:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871a800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707512.908197:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec1dc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.908205:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec1dc0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.908219:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa06897400) 00010000:00010000:2.0:1787707512.908222:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707512.908227:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec1dc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.908233:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec1dc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.908252:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.908258:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1dc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.908264:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1dc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.908269:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871a600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707512.908271:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1dc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.908277:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1dc7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.908285:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cfa12a49200) 00010000:00010000:2.0:1787707512.908287:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707512.908290:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1dc7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.908295:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1dc7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.908327:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1db9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba13c expref: 10 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.908338:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa06897400) 00010000:00010000:2.0:1787707512.908340:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707512.908350:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1db9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba13c expref: 10 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707512.908359:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871be00, rc 0) 00000100:00100000:2.0:1787707512.908489:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+9:14467:x1874546707778432:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 771us (984us total) trans 0 rc 301/301 00000100:00100000:2.0:1787707512.908497:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 18 00000100:00100000:2.0:1787707512.925159:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707512.925265:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707778560 00000100:00100000:3.0:1787707512.925276:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707778560 00000100:00100000:3.0:1787707512.925337:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 0 00000100:00100000:3.0:1787707512.925348:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+9:14467:x1874546707778560:12345-192.168.204.46@tcp:700:lfs.0 00000100:00100000:3.0:1787707512.925460:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+9:14467:x1874546707778560:12345-192.168.204.46@tcp:700:lfs.0 Request processed in 113us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707512.925468:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 0 00000100:00100000:0.0:1787707512.929432:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707512.929525:0:15848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707778816 00000100:00100000:1.0:1787707512.929548:0:15848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707778816 00000100:00100000:1.0:1787707512.929609:0:15848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 19 00000100:00100000:1.0:1787707512.929619:0:15848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+9:14467:x1874546707778816:12345-192.168.204.46@tcp:36:lfs.0 00010000:00010000:1.0:1787707512.929680:0:15848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787707512.929723:0:15848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1cfc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba0b7 expref: 9 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.929744:0:15848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa06897400) 00010000:00010000:1.0:1787707512.929749:0:15848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787707512.930041:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1dce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.930057:0:15848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc000/0xc5f18d5f94ec1d34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba119 expref: 5 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.930066:0:15848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1dce lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.930102:0:15848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc000/0xc5f18d5f94ec1d34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba119 expref: 5 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.930117:0:15848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc000/0xc5f18d5f94ec1d34 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba119 expref: 5 pid: 14429 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707512.930132:0:15848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15848:1874546729796480:192.168.204.46@tcp:104: 00000100:00100000:1.0:1787707512.930538:0:15848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa06fa70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707512.944185:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707512.944323:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707778944 00000100:00100000:3.0:1787707512.944333:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707778944 00010000:00010000:3.0:1787707512.944415:0:14415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc000/0xc5f18d5f94ec1d34 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba119 expref: 6 pid: 14429 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707512.944451:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 9 00000100:00100000:3.0:1787707512.944461:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+6:2361:x1874546707778944:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787707512.944474:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707512.944482:0:14415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc000/0xc5f18d5f94ec1d34 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba119 expref: 6 pid: 14429 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707512.944497:0:14415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc000/0xc5f18d5f94ec1d34 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba119 expref: 6 pid: 14429 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707512.944521:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa06897400) 00010000:00010000:3.0:1787707512.944527:0:14415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1dce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707512.944550:0:14415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1dce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707512.944557:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1dce lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707512.944576:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707512.944624:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+6:2361:x1874546707778944:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 164us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707512.944632:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 9 00010000:00010000:1.0:1787707512.944986:0:15848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc000/0xc5f18d5f94ec1d34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba119 expref: 5 pid: 14429 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707512.945019:0:15848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15848:1874546729796480:192.168.204.46@tcp:104: 00010000:00010000:1.0:1787707512.945041:0:15848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1dce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.945050:0:15848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1dce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.945056:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1dce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.945080:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1dd5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.945089:0:15848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.945096:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707512.946510:0:15848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787707512.946525:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1dce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.946534:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1dce lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.946541:0:15848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1dce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.946547:0:15848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707512.946558:0:15848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1dce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.946565:0:15848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1dce lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.946579:0:15848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa06897400) 00010000:00010000:1.0:1787707512.946582:0:15848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707512.946586:0:15848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1dce lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707512.946592:0:15848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1dce lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787707512.946611:0:15848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009dcf56b5 reply state 0000000070ba74d9 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707512.946619:0:15848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787707512.946700:0:15848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+10:14467:x1874546707778816:12345-192.168.204.46@tcp:36:lfs.0 Request processed in 17080us (17277us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787707512.946710:0:15848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 19 00000100:00080000:0.0:1787707512.950613:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787707512.953699:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707512.953718:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1dd5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707512.953726:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1dd5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707512.953733:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707512.953738:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1dd5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707512.953746:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1dd5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707512.953764:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cfa06897500) 00010000:00010000:3.0:1787707512.953767:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707512.953771:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1dd5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707512.953798:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4200/0xc5f18d5f94ec1dd5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707513.030244:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707513.031954:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707779072 00000100:00100000:2.0:1787707513.031973:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707779072 00000100:00100000:2.0:1787707513.032053:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 20 00000100:00100000:2.0:1787707513.032064:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+9:14475:x1874546707779072:12345-192.168.204.46@tcp:101:lctl.0 00010000:00010000:2.0:1787707513.032094:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707513.032121:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1ddc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba143 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.032211:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec1de3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.032226:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec1de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.032241:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec1de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707513.032306:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787707513.032310:0:14431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787707513.032352:0:14431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec1de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.032447:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1ddc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba143 expref: 11 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.032468:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a800/0xc5f18d5f94ec1de3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba143 expref: 10 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.032476:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49200) 00010000:00010000:2.0:1787707513.032479:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787707513.032483:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871a800, rc 0) 00000100:00100000:2.0:1787707513.032542:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+10:14475:x1874546707779072:12345-192.168.204.46@tcp:101:lctl.0 Request processed in 480us (2308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707513.032550:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 20 00000100:00100000:0.0:1787707513.062404:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707513.066956:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707779200 00000100:00100000:3.0:1787707513.066972:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707779200 00000100:00100000:3.0:1787707513.067049:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 21 00000100:00100000:3.0:1787707513.067059:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+5:14476:x1874546707779200:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:3.0:1787707513.067081:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707513.067101:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc600/0xc5f18d5f94ec1dea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba14a expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.067174:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc000/0xc5f18d5f94ec1df1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.067188:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc000/0xc5f18d5f94ec1df1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.067200:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc000/0xc5f18d5f94ec1df1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707513.067257:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787707513.067261:0:14429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787707513.067286:0:14429:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc000/0xc5f18d5f94ec1df1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.067310:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc600/0xc5f18d5f94ec1dea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba14a expref: 7 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.067329:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc000/0xc5f18d5f94ec1df1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba14a expref: 6 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.067350:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49200) 00010000:00010000:3.0:1787707513.067353:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787707513.067357:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa013fc000, rc 0) 00000100:00100000:3.0:1787707513.067460:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+6:14476:x1874546707779200:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 402us (5089us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707513.067467:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 21 00000100:00100000:0.0:1787707513.070520:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707513.070630:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707779328 00000100:00100000:2.0:1787707513.070640:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707779328 00000100:00100000:2.0:1787707513.070705:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 22 00000100:00100000:2.0:1787707513.070715:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f288ac8a-880e-4537-b6b8-0ab57669b2f5+6:14476:x1874546707779328:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:2.0:1787707513.070735:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707513.070755:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1df8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba151 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.070842:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1dff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.070857:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1dff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.070869:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1dff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.070900:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1e06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.070908:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1e06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.070914:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1e06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.071046:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1e0d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.071055:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1e0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.071062:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1e0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707513.071104:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787707513.071108:0:14431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787707513.071133:0:14431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1e0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.071146:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1dff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.071153:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1dff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.071160:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1dff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.071176:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871b400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707513.071180:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1dff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.071189:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1dff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.071201:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49200) 00010000:00010000:2.0:1787707513.071204:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707513.071209:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1dff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.071216:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1dff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.071230:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1e06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.071237:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1e06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.071242:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1e06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.071248:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871a400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707513.071251:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1e06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.071257:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1e06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.071275:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cfa12a49f00) 00010000:00010000:2.0:1787707513.071278:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707513.071280:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1e06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.071285:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1e06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.071315:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1df8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba151 expref: 8 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.071329:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1e0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba151 expref: 7 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.071337:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cfa12a49d00) 00010000:00010000:2.0:1787707513.071340:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787707513.071342:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871be00, rc 0) 00000100:00100000:2.0:1787707513.071445:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f288ac8a-880e-4537-b6b8-0ab57669b2f5+7:14476:x1874546707779328:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 731us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707513.071454:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 22 00000100:00100000:0.0:1787707513.079076:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707513.079178:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707779584 00000100:00100000:3.0:1787707513.079189:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707779584 00000100:00100000:3.0:1787707513.079251:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 23 00000100:00100000:3.0:1787707513.079263:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3a57ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+7:14476:x1874546707779584:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:3.0:1787707513.079285:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707513.079308:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc600/0xc5f18d5f94ec1e14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba158 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707513.079464:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787707513.079607:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc600/0xc5f18d5f94ec1e14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba158 expref: 9 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.079624:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49200) 00010000:00010000:3.0:1787707513.079627:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787707513.079632:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc600/0xc5f18d5f94ec1e14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba158 expref: 9 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.079647:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa013fc600, rc 0) 00000100:00100000:3.0:1787707513.079974:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3a57ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+8:14476:x1874546707779584:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 712us (908us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1787707513.079998:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 23 00000040:00080000:1.0:1787707513.081131:0:14460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787707513.091077:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707513.094962:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707779840 00000100:00100000:2.0:1787707513.094977:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707779840 00000100:00100000:2.0:1787707513.095115:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 24 00000100:00100000:2.0:1787707513.095126:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f288ac8a-880e-4537-b6b8-0ab57669b2f5+8:14476:x1874546707779840:12345-192.168.204.46@tcp:36:lfs.0 00010000:00010000:2.0:1787707513.095193:0:14431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707513.095224:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1e0d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba151 expref: 8 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.097140:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cfa12a49d00) 00010000:00010000:2.0:1787707513.097163:0:14431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787707513.097217:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1e22 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.097233:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1e22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.097245:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1e22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787707513.097690:0:14431:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4ec6c12 reply state 000000008903aeab transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1e22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707513.097702:0:14431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787707513.097719:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1787707513.098758:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f288ac8a-880e-4537-b6b8-0ab57669b2f5+9:14476:x1874546707779840:12345-192.168.204.46@tcp:36:lfs.0 Request processed in 2682us (6740us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787707513.098770:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 24 00010000:00010000:3.0:1787707513.102441:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1e22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.102460:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1e22 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.102470:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1e22 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.102478:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871a600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707513.102495:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1e22 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.102505:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1e22 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.102524:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cfa12a49f00) 00010000:00010000:3.0:1787707513.102528:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787707513.102533:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1e22 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.102539:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1e22 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707513.107736:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707513.107827:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707780096 00000100:00100000:2.0:1787707513.107838:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707780096 00000100:00100000:2.0:1787707513.107900:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 2 00000100:00100000:2.0:1787707513.107911:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+8:14476:x1874546707780096:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:2.0:1787707513.108174:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+9:14476:x1874546707780096:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 264us (448us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787707513.108182:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 2 00000100:00100000:0.0:1787707513.121512:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707513.122131:0:15848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707780352 00000100:00100000:1.0:1787707513.122143:0:15848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707780352 00000100:00100000:1.0:1787707513.122217:0:15848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 25 00000100:00100000:1.0:1787707513.122228:0:15848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f288ac8a-880e-4537-b6b8-0ab57669b2f5+9:14476:x1874546707780352:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:1.0:1787707513.122255:0:15848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707513.122277:0:15848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1e29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba15f expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.122364:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.122622:0:15848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.122635:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.122653:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.122660:0:15848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.122667:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707513.122795:0:15848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787707513.122900:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.122909:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e30 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.122916:0:15848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.122922:0:15848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707513.122926:0:15848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.122943:0:15848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.122956:0:15848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49200) 00010000:00010000:1.0:1787707513.122959:0:15848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707513.122965:0:15848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.122971:0:15848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.122985:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.122992:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.122997:0:15848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.123003:0:15848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4c00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707513.123006:0:15848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.123012:0:15848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.123019:0:15848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cfa06897400) 00010000:00010000:1.0:1787707513.123021:0:15848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707513.123024:0:15848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.123356:0:15848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707513.124518:0:15848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1e29 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba15f expref: 11 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707513.124535:0:15848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49200) 00010000:00010000:0.0:1787707513.124537:0:15848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787707513.124542:0:15848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1e29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba15f expref: 11 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707513.124557:0:15848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d4800, rc 0) 00000100:00100000:0.0:1787707513.124623:0:15848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f288ac8a-880e-4537-b6b8-0ab57669b2f5+10:14476:x1874546707780352:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 2396us (3120us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787707513.124631:0:15848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 25 00000100:00100000:0.0:1787707513.138161:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707513.138740:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707780480 00000100:00100000:1.0:1787707513.138752:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707780480 00000100:00100000:1.0:1787707513.138830:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 26 00000100:00100000:1.0:1787707513.138842:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+10:14476:x1874546707780480:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:1.0:1787707513.138877:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707513.138901:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e45 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba166 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.138986:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e4c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.139000:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.139012:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707513.139061:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787707513.139065:0:14430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787707513.139088:0:14430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.139117:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e45 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba166 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.139136:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba166 expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.139159:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cfa06897400) 00010000:00010000:1.0:1787707513.139162:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787707513.139166:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d4000, rc 0) 00000100:00100000:1.0:1787707513.139232:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+11:14476:x1874546707780480:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 392us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707513.139239:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 26 00000100:00100000:1.0:1787707513.146453:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707513.146719:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707780608 00000100:00100000:2.0:1787707513.146744:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707780608 00000100:00100000:2.0:1787707513.146802:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 3 00000100:00100000:2.0:1787707513.146825:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+11:14476:x1874546707780608:12345-192.168.204.46@tcp:37:lfs.0 00000100:00100000:3.0:1787707513.154314:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+11:14476:x1874546707780608:12345-192.168.204.46@tcp:37:lfs.0 Request processed in 7479us (7859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707513.154327:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 3 00000100:00100000:0.0:1787707513.169491:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707513.169849:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707780864 00000100:00100000:3.0:1787707513.169861:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707780864 00000100:00100000:3.0:1787707513.169937:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 4 00000100:00100000:3.0:1787707513.169949:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f35fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+11:14476:x1874546707780864:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:3.0:1787707513.170418:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f35fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+12:14476:x1874546707780864:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 470us (936us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787707513.170426:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 4 00000100:00100000:3.0:1787707513.245672:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707513.245944:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707780992 00000100:00100000:0.0:1787707513.245956:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707780992 00000100:00100000:0.0:1787707513.246018:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 27 00000100:00100000:0.0:1787707513.246029:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+10:14482:x1874546707780992:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:0.0:1787707513.246050:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707513.246071:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1e53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba16d expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707513.246135:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec1e5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707513.246162:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec1e5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707513.246176:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec1e5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707513.246205:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec1e61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707513.246212:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec1e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707513.246219:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec1e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707513.246325:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2c00/0xc5f18d5f94ec1e68 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707513.246334:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2c00/0xc5f18d5f94ec1e68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707513.246340:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2c00/0xc5f18d5f94ec1e68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787707513.246619:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787707513.246624:0:14429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787707513.247570:0:14429:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2c00/0xc5f18d5f94ec1e68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.247590:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec1e5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.247596:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec1e5a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.247602:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec1e5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.247608:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2e00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707513.247612:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec1e5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.247619:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec1e5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.247634:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49200) 00010000:00010000:3.0:1787707513.247636:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707513.247641:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec1e5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.247647:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2e00/0xc5f18d5f94ec1e5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.247676:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec1e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.247682:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec1e61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.247700:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec1e61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.247705:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3e00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707513.247708:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec1e61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.247714:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec1e61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.247722:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cfa19f4ef00) 00010000:00010000:3.0:1787707513.247724:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707513.247727:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec1e61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.247732:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3e00/0xc5f18d5f94ec1e61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.247772:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd3000/0xc5f18d5f94ec1e53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba16d expref: 12 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.247787:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa3fcd2c00/0xc5f18d5f94ec1e68 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba16d expref: 11 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.247819:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cfa06897400) 00010000:00010000:3.0:1787707513.247822:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787707513.247824:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd2c00, rc 0) 00000100:00100000:3.0:1787707513.248441:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+11:14482:x1874546707780992:12345-192.168.204.46@tcp:101:bash.0 Request processed in 2410us (2776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707513.248451:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 27 00000100:00100000:2.0:1787707513.251882:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707513.253094:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707781248 00000100:00100000:1.0:1787707513.253106:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707781248 00000100:00100000:1.0:1787707513.253310:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 28 00000100:00100000:1.0:1787707513.253322:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+11:14482:x1874546707781248:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:1.0:1787707513.253344:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707513.253469:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec1e6f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba174 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.253603:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e76 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.253618:0:14430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e4c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba166 expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.253627:0:14430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e76 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.253662:0:14430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba166 expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.253764:0:14430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e4c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba166 expref: 11 pid: 14430 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707513.253778:0:14430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14430:1874546729796608:192.168.204.46@tcp:104: 00000100:00100000:1.0:1787707513.254019:0:14430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa06fa70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787707513.265287:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707513.265916:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707781376 00000100:00100000:2.0:1787707513.265927:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707781376 00010000:00010000:2.0:1787707513.265974:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e4c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba166 expref: 12 pid: 14430 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707513.266013:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 10 00000100:00100000:2.0:1787707513.266023:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+12:2361:x1874546707781376:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787707513.266037:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707513.266044:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e4c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba166 expref: 12 pid: 14430 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.266059:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e4c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba166 expref: 12 pid: 14430 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.266082:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cfa06897400) 00010000:00010000:2.0:1787707513.266088:0:14414:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e76 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.266097:0:14414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e76 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.266105:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e76 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.266122:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707513.266202:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+12:2361:x1874546707781376:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 180us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707513.266209:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 10 00010000:00010000:1.0:1787707513.267206:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4000/0xc5f18d5f94ec1e4c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba166 expref: 11 pid: 14430 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707513.267227:0:14430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14430:1874546729796608:192.168.204.46@tcp:104: 00010000:00010000:1.0:1787707513.267248:0:14430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e76 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.267257:0:14430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e76 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.267264:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e76 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.267287:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4e00/0xc5f18d5f94ec1e7d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.267298:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4e00/0xc5f18d5f94ec1e7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.267307:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4e00/0xc5f18d5f94ec1e7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.268849:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1e84 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.268872:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1e84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.268884:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1e84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707513.269025:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787707513.269061:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e76 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.269069:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e76 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.269076:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e76 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.269082:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4c00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707513.269087:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e76 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.269402:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e76 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.269415:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cfa06897400) 00010000:00010000:1.0:1787707513.269419:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707513.269423:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e76 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.269429:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4c00/0xc5f18d5f94ec1e76 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787707513.269442:0:14430:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d110988 reply state 000000004121d0fa transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4e00/0xc5f18d5f94ec1e7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707513.269455:0:14430:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787707513.269495:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec1e6f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba174 expref: 14 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.269509:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1e84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba174 expref: 13 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.269516:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfa06897100) 00010000:00010000:1.0:1787707513.269518:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787707513.269520:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d4800, rc 0) 00000100:00100000:1.0:1787707513.269648:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+14:14482:x1874546707781248:12345-192.168.204.46@tcp:101:bash.0 Request processed in 16327us (17777us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787707513.269657:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 28 00010000:00010000:3.0:1787707513.292553:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4e00/0xc5f18d5f94ec1e7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.292572:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4e00/0xc5f18d5f94ec1e7d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.292579:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4e00/0xc5f18d5f94ec1e7d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.292586:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4e00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707513.292591:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4e00/0xc5f18d5f94ec1e7d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.292600:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4e00/0xc5f18d5f94ec1e7d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.292620:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cfa06897700) 00010000:00010000:3.0:1787707513.292623:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707513.292628:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4e00/0xc5f18d5f94ec1e7d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.292634:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4e00/0xc5f18d5f94ec1e7d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707513.298208:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707513.298752:0:15848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707781504 00000100:00100000:3.0:1787707513.298764:0:15848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707781504 00000100:00100000:3.0:1787707513.298983:0:15848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 29 00000100:00100000:3.0:1787707513.298994:0:15848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+13:14482:x1874546707781504:12345-192.168.204.46@tcp:101:bash.0 00010000:00010000:3.0:1787707513.299019:0:15848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707513.299039:0:15848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc600/0xc5f18d5f94ec1e92 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba17b expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.299101:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1e99 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.299113:0:15848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1e99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.299124:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1e99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707513.301395:0:15848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787707513.301404:0:15848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787707513.301439:0:15848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1e99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.301455:0:15848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1e99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.301493:0:15848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa013fc600/0xc5f18d5f94ec1e92 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba17b expref: 15 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.301513:0:15848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1e99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba17b expref: 14 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.301537:0:15848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfa06897100) 00010000:00010000:3.0:1787707513.301540:0:15848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787707513.301544:0:15848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a14200, rc 0) 00000100:00100000:3.0:1787707513.301630:0:15848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+14:14482:x1874546707781504:12345-192.168.204.46@tcp:101:bash.0 Request processed in 2637us (3432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707513.301639:0:15848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 29 00000100:00100000:0.0:1787707513.308179:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707513.308268:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707781760 00000100:00100000:3.0:1787707513.308279:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707781760 00000100:00100000:3.0:1787707513.308342:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 5 00000100:00100000:3.0:1787707513.308352:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+14:14482:x1874546707781760:12345-192.168.204.46@tcp:35:bash.0 00000100:00100000:3.0:1787707513.308712:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+15:14482:x1874546707781760:12345-192.168.204.46@tcp:35:bash.0 Request processed in 361us (546us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787707513.308721:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 5 00000100:00100000:2.0:1787707513.431254:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707513.431819:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707782016 00000100:00100000:1.0:1787707513.431830:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707782016 00000100:00100000:1.0:1787707513.431908:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 30 00000100:00100000:1.0:1787707513.431919:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+15:14492:x1874546707782016:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:1.0:1787707513.431944:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707513.431967:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec1ea0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba182 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707513.432085:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787707513.432226:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec1ea0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba182 expref: 17 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.432241:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfa12a49200) 00010000:00010000:1.0:1787707513.432257:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787707513.432264:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec1ea0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba182 expref: 17 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.432280:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d5000, rc 0) 00000100:00100000:1.0:1787707513.432349:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+16:14492:x1874546707782016:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 432us (1105us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787707513.432357:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 30 00000100:00100000:3.0:1787707513.435485:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707513.435772:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707782272 00000100:00100000:0.0:1787707513.435780:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707782272 00000100:00100000:0.0:1787707513.435844:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 6 00000100:00100000:0.0:1787707513.435856:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+16:14492:x1874546707782272:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:0.0:1787707513.436100:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+17:14492:x1874546707782272:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 246us (622us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787707513.436108:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 6 00000100:00100000:0.0:1787707513.488599:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707513.488688:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707782528 00000100:00100000:3.0:1787707513.488698:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707782528 00000100:00100000:3.0:1787707513.488763:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 31 00000100:00100000:3.0:1787707513.488775:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+17:14495:x1874546707782528:12345-192.168.204.46@tcp:101:lfs.0 00010000:00010000:3.0:1787707513.488811:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707513.488834:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec1eae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba189 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.488935:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec1eb5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.488966:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec1eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.488978:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec1eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707513.488990:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787707513.489125:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec1eae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba189 expref: 20 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.489146:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec1eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba189 expref: 19 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.489155:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfa06897100) 00010000:00010000:3.0:1787707513.489158:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787707513.489161:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a15a00, rc 0) 00000100:00100000:3.0:1787707513.489236:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+19:14495:x1874546707782528:12345-192.168.204.46@tcp:101:lfs.0 Request processed in 464us (648us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1787707513.489243:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 31 00000100:00100000:2.0:1787707513.494904:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707513.494953:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707513.495109:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707782656 00000100:00100000:1.0:1787707513.495119:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707782656 00000100:00100000:1.0:1787707513.495183:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 32 00000100:00100000:1.0:1787707513.495194:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+19:14495:x1874546707782656:12345-192.168.204.46@tcp:54:lfs.0 00010000:00010000:1.0:1787707513.495266:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec1ec3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.495284:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec1ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.495294:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec1ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.495322:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec1ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.495329:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec1ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.495335:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec1ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.495340:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d5000 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707513.495360:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec1ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.495411:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec1ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.495426:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfa06897100) 00010000:00010000:1.0:1787707513.495430:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787707513.495434:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec1ec3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.495441:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d5000/0xc5f18d5f94ec1ec3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707513.495504:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+19:14495:x1874546707782656:12345-192.168.204.46@tcp:54:lfs.0 Request processed in 312us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707513.495513:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 32 00000100:00100000:3.0:1787707513.498285:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707782784 00000100:00100000:3.0:1787707513.498300:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707782784 00000100:00100000:3.0:1787707513.498465:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 0 00000100:00100000:3.0:1787707513.498477:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08770a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+19:2360:x1874546707782784:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787707513.498492:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707513.498516:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec1eb5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba189 expref: 19 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.498550:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfa06897100) 00010000:00010000:3.0:1787707513.498555:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707513.498618:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08770a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+18:2360:x1874546707782784:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 143us (3663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707513.498625:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 0 00000100:00100000:0.0:1787707513.498746:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707513.499004:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707783040 00000100:00100000:3.0:1787707513.499009:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707783040 00000100:00100000:3.0:1787707513.499044:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 7 00000100:00100000:3.0:1787707513.499051:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+18:14495:x1874546707783040:12345-192.168.204.46@tcp:35:lfs.0 00000100:00100000:3.0:1787707513.499504:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+19:14495:x1874546707783040:12345-192.168.204.46@tcp:35:lfs.0 Request processed in 450us (756us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787707513.499511:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 7 00010000:00010000:0.0:1787707513.720822:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707513.861717:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707513.861957:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707783296 00000100:00100000:3.0:1787707513.861968:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707783296 00000100:00100000:3.0:1787707513.862036:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 33 00000100:00100000:3.0:1787707513.862047:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+19:14526:x1874546707783296:12345-192.168.204.46@tcp:101:cat.0 00010000:00010000:3.0:1787707513.862074:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707513.862095:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec1eca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba190 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.862225:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec1ed1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.862240:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec1ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.862270:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec1ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707513.862282:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787707513.862456:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec1eca lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba190 expref: 22 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.862476:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec1ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba190 expref: 21 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.862486:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfa06897100) 00010000:00010000:3.0:1787707513.862489:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787707513.862493:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a14600, rc 0) 00000100:00100000:3.0:1787707513.862557:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+21:14526:x1874546707783296:12345-192.168.204.46@tcp:101:cat.0 Request processed in 512us (851us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1787707513.862565:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 33 00000100:00100000:1.0:1787707513.872679:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707513.872712:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707783552 00000100:00100000:1.0:1787707513.872718:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707513.872723:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707783552 00000100:00100000:0.0:1787707513.872823:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 8 00000100:00100000:0.0:1787707513.872834:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+21:14526:x1874546707783552:12345-192.168.204.46@tcp:35:cat.0 00000100:00100000:0.0:1787707513.873830:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+22:14526:x1874546707783552:12345-192.168.204.46@tcp:35:cat.0 Request processed in 994us (1159us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787707513.873841:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 8 00000100:00100000:2.0:1787707513.874065:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707783680 00000100:00100000:2.0:1787707513.874071:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707783680 00000100:00100000:2.0:1787707513.874120:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 1 00000100:00100000:2.0:1787707513.874130:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+22:2361:x1874546707783680:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787707513.874142:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707513.874177:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14600/0xc5f18d5f94ec1ed1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba190 expref: 22 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.874196:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfa06897100) 00010000:00010000:2.0:1787707513.874202:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707513.874236:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+21:2361:x1874546707783680:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 109us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707513.874243:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 1 00000100:00100000:1.0:1787707513.941299:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707513.941461:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707783936 00000100:00100000:2.0:1787707513.941472:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707783936 00000100:00100000:2.0:1787707513.941532:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 34 00000100:00100000:2.0:1787707513.941543:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+21:14532:x1874546707783936:12345-192.168.204.46@tcp:101:dd.0 00010000:00010000:2.0:1787707513.941567:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707513.941601:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1edf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba197 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.941729:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1ee6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.941743:0:14431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1e84 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba174 expref: 22 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.941751:0:14431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1e99 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba17b expref: 22 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.941758:0:14431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1ee6 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.941803:0:14431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1e99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba17b expref: 22 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.941827:0:14431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1e99 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba17b expref: 22 pid: 15848 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707513.941840:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08772d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14431:1874546729796736:192.168.204.46@tcp:104: 00010000:00010000:2.0:1787707513.941948:0:14431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1e84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba174 expref: 22 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.941958:0:14431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1e84 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba174 expref: 22 pid: 14430 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707513.941967:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa08772680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14431:1874546729796864:192.168.204.46@tcp:104: 00000100:00100000:2.0:1787707513.942001:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07f65f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787707513.948595:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707513.948639:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707513.948720:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707784064 00000100:00100000:3.0:1787707513.948723:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707784192 00000100:00100000:3.0:1787707513.948730:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707784192 00000100:00100000:0.0:1787707513.948730:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707784064 00010000:00010000:3.0:1787707513.948769:0:14415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1e84 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba174 expref: 24 pid: 14430 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707513.948769:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1e99 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba17b expref: 24 pid: 15848 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707513.948930:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 11 00000100:00100000:0.0:1787707513.948941:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3f9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+24:2362:x1874546707784064:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787707513.948960:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787707513.948968:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1e99 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba17b expref: 24 pid: 15848 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707513.948983:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1e99 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba17b expref: 24 pid: 15848 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707513.949007:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfa06897100) 00010000:00010000:0.0:1787707513.949013:0:14414:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1ee6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707513.949036:0:14414:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1ee6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707513.949043:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707513.949050:0:14415:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787707513.949058:0:14415:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787707513.949096:0:14416:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787707513.949096:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3f9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+24:2362:x1874546707784064:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 157us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707513.949104:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 12 00000100:00100000:3.0:1787707513.949111:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+24:2362:x1874546707784192:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787707513.949120:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707513.949132:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1e84 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba174 expref: 24 pid: 14430 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.949143:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1e84 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba174 expref: 24 pid: 14430 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.949154:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfa06897100) 00010000:00010000:1.0:1787707513.949543:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14200/0xc5f18d5f94ec1e99 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba17b expref: 24 pid: 15848 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707513.949559:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08772d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14431:1874546729796736:192.168.204.46@tcp:104: 00010000:00010000:1.0:1787707513.949571:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1e84 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba174 expref: 23 pid: 14430 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707513.949582:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa08772680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14431:1874546729796864:192.168.204.46@tcp:104: 00000100:00100000:0.0:1787707513.949641:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 11 00010000:00010000:3.0:1787707513.950345:0:14416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1ee6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.950356:0:14416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1ee6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.950363:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1ee6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.950450:0:14431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1ee6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.950540:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707513.950592:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+21:2362:x1874546707784192:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 1479us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707513.950600:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 12 00010000:00010000:1.0:1787707513.950735:0:14431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1ee6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.950743:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1ee6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787707513.950764:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787707513.952502:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1edf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba197 expref: 22 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.952538:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a600/0xc5f18d5f94ec1ee6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba197 expref: 21 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.952547:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfa06897100) 00010000:00010000:1.0:1787707513.952550:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787707513.952554:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871a600, rc 0) 00000100:00100000:1.0:1787707513.954819:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+21:14532:x1874546707783936:12345-192.168.204.46@tcp:101:dd.0 Request processed in 13246us (13498us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787707513.954834:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 34 00000100:00100000:0.0:1787707513.958842:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707513.959011:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707784448 00000100:00100000:3.0:1787707513.959023:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707784448 00000100:00100000:3.0:1787707513.959126:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 35 00000100:00100000:3.0:1787707513.959138:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+21:14532:x1874546707784448:12345-192.168.204.46@tcp:36:dd.0 00010000:00010000:3.0:1787707513.959471:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec1ef4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.959489:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec1ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.959502:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec1ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787707513.959554:0:14429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1787707513.959703:0:14429:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a14d3f5d reply state 000000003cf1299a transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec1ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707513.959727:0:14429:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787707513.959842:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+24:14532:x1874546707784448:12345-192.168.204.46@tcp:36:dd.0 Request processed in 705us (1010us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1787707513.959849:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 35 00000020:00080000:3.0:1787707513.959854:0:14429:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787707513.962069:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec1ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.962086:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec1ef4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.962095:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec1ef4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.962101:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15a00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:1.0:1787707513.962123:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec1ef4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.962132:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec1ef4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.962224:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfa06897100) 00010000:00010000:1.0:1787707513.962227:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787707513.962232:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec1ef4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.962300:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15a00/0xc5f18d5f94ec1ef4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707513.965337:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707513.965630:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707784576 00000100:00100000:1.0:1787707513.965640:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707784576 00000100:00100000:1.0:1787707513.965704:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 36 00000100:00100000:1.0:1787707513.965714:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+23:14532:x1874546707784576:12345-192.168.204.46@tcp:101:dd.0 00010000:00010000:1.0:1787707513.965738:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787707513.965758:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1efb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba19e expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.965840:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1efb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba19e expref: 24 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.965855:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1efb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba19e expref: 24 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707513.965877:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfa06897100) 00010000:00010000:1.0:1787707513.965881:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787707513.965908:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa029d4800, rc 0) 00000100:00100000:1.0:1787707513.965971:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+24:14532:x1874546707784576:12345-192.168.204.46@tcp:101:dd.0 Request processed in 258us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707513.965978:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 36 00000100:00100000:2.0:1787707513.979616:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707513.979713:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707784832 00000100:00100000:3.0:1787707513.979725:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707784832 00000100:00100000:3.0:1787707513.979858:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 2 00000100:00100000:3.0:1787707513.979869:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+24:14532:x1874546707784832:12345-192.168.204.46@tcp:103:dd.0 00010000:00010000:3.0:1787707513.979886:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787707513.979911:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa029d4800/0xc5f18d5f94ec1efb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba19e expref: 24 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.979932:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfa06897100) 00010000:00010000:3.0:1787707513.979937:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787707513.980000:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+23:14532:x1874546707784832:12345-192.168.204.46@tcp:103:dd.0 Request processed in 133us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707513.980008:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 2 00000100:00100000:0.0:1787707513.983237:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707513.983501:0:15848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707784960 00000100:00100000:3.0:1787707513.983511:0:15848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707784960 00000100:00100000:3.0:1787707513.983604:0:15848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 37 00000100:00100000:3.0:1787707513.983615:0:15848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+23:14532:x1874546707784960:12345-192.168.204.46@tcp:58:dd.0 00010000:00010000:3.0:1787707513.983725:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1f02 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.983744:0:15848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1f02 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707513.983771:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1f02 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787707513.986051:0:15848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787707513.986216:0:15848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787707513.986357:0:15848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787707513.986682:0:15848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+23:14532:x1874546707784960:12345-192.168.204.46@tcp:58:dd.0 Request processed in 3062us (3449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707513.986695:0:15848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 37 00000100:00100000:0.0:1787707513.993161:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707513.993534:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707785088 00000100:00100000:2.0:1787707513.993546:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707785088 00000100:00100000:2.0:1787707513.993735:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 38 00000100:00100000:2.0:1787707513.993746:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+23:14532:x1874546707785088:12345-192.168.204.46@tcp:101:dd.0 00010000:00010000:2.0:1787707513.993768:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707513.993803:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1f09 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba1a5 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.993869:0:14430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1f02 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.993882:0:14430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1f09 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1a5 expref: 24 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.993919:0:14430:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1f02 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.993933:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1f09 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1a5 expref: 24 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.993947:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfa06897100) 00010000:00010000:2.0:1787707513.993950:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787707513.993954:0:14430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1f09 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1a5 expref: 24 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707513.993961:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871b400, rc 0) 00000100:00100000:2.0:1787707513.994028:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+24:14532:x1874546707785088:12345-192.168.204.46@tcp:101:dd.0 Request processed in 283us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707513.994036:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 38 00000040:00080000:1.0:1787707514.107437:0:14460:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787707514.107446:0:14460:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787707514.107483:0:14460:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787707514.107490:0:14460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787707514.107619:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa34c13b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14460:1874546729796992:192.168.204.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787707514.107744:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa04f91e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787707514.116270:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa34c13b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14460:1874546729796992:192.168.204.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787707514.120080:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707514.120343:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707785216 00000100:00100000:3.0:1787707514.120353:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707785216 00000100:00080000:0.0:1787707514.120568:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787707514.120612:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 0 00000100:00100000:3.0:1787707514.120625:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+24:14533:x1874546707785216:12345-192.168.204.46@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787707514.120724:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+24:14533:x1874546707785216:12345-192.168.204.46@tcp:900:lhsmtool_posix.0 Request processed in 102us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707514.120732:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 0 00000100:00100000:0.0:1787707514.125867:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707514.125944:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707785344 00000100:00100000:3.0:1787707514.125954:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707785344 00000100:00100000:3.0:1787707514.126008:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 39 00000100:00100000:3.0:1787707514.126019:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+24:14533:x1874546707785344:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787707514.126052:0:14429:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787707514.126321:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+24:14533:x1874546707785344:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 Request processed in 303us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707514.126330:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 39 00000100:00100000:0.0:1787707514.130939:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707514.131002:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707785472 00000100:00100000:3.0:1787707514.131011:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707785472 00000100:00100000:3.0:1787707514.131076:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 40 00000100:00100000:3.0:1787707514.131088:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+24:14533:x1874546707785472:12345-192.168.204.46@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787707514.131277:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1f10 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.131295:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1f10 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.131323:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1f10 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.131917:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1f17 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.131928:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1f17 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.131937:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1f17 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.131963:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f1e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.131973:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.131979:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787707514.132021:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787707514.132025:0:14431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787707514.132042:0:14431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.132053:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1f10 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.133295:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1f10 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.133320:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1f10 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.133326:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707514.133330:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1f10 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.133338:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1f10 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.133354:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfa06897800) 00010000:00010000:3.0:1787707514.133357:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707514.133361:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1f10 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.133367:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1f10 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.133396:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1f17 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.133402:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1f17 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.133407:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1f17 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.133412:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707514.133415:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1f17 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.133429:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1f17 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.133437:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8cfa12a27100) 00010000:00010000:3.0:1787707514.133440:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707514.133442:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1f17 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.133447:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1f17 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.133466:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.133471:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f1e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.133476:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f1e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.133481:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14a00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707514.133483:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f1e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.133489:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f1e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.133495:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfa06897100) 00010000:00010000:3.0:1787707514.133497:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707514.133500:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f1e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.133514:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f1e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707514.134334:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+24:14533:x1874546707785472:12345-192.168.204.46@tcp:34:lhsmtool_posix.0 Request processed in 3239us (3395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707514.134344:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 40 00000100:00100000:0.0:1787707514.143731:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707514.143845:0:15848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707785728 00000100:00100000:2.0:1787707514.143857:0:15848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707785728 00000100:00100000:2.0:1787707514.143918:0:15848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 41 00000100:00100000:2.0:1787707514.143930:0:15848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+24:14533:x1874546707785728:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787707514.143956:0:15848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707514.143978:0:15848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1f25 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba1ac expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.144107:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1f2c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.144123:0:15848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1f2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.144143:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1f2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707514.144164:0:15848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787707514.144262:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1f2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.144270:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1f2c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.144276:0:15848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1f2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.144282:0:15848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa0871a400 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707514.144287:0:15848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1f2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.144294:0:15848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1f2c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.144306:0:15848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfa06897100) 00010000:00010000:2.0:1787707514.144309:0:15848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787707514.144314:0:15848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1f2c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.144320:0:15848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1f2c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.144366:0:15848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1f25 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1ac expref: 26 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.144442:0:15848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfa06897800) 00010000:00010000:2.0:1787707514.144445:0:15848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787707514.144450:0:15848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871be00/0xc5f18d5f94ec1f25 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1ac expref: 26 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.144459:0:15848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa0871be00, rc 0) 00000100:00100000:2.0:1787707514.144528:0:15848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+25:14533:x1874546707785728:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 600us (819us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1787707514.144536:0:15848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 41 00000100:00100000:0.0:1787707514.148168:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707514.148328:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707785856 00000100:00100000:2.0:1787707514.148337:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707785856 00000100:00100000:2.0:1787707514.148425:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 42 00000100:00100000:2.0:1787707514.148435:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+25:14533:x1874546707785856:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787707514.148473:0:14430:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787707514.148573:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+25:14533:x1874546707785856:12345-192.168.204.46@tcp:53:lhsmtool_posix.0 Request processed in 139us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707514.148581:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 42 00000100:00100000:1.0:1787707514.152849:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707514.153194:0:15848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707786112 00000100:00100000:2.0:1787707514.153205:0:15848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707786112 00000100:00100000:2.0:1787707514.153266:0:15848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 43 00000100:00100000:2.0:1787707514.153277:0:15848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+25:14533:x1874546707786112:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787707514.153299:0:15848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707514.153319:0:15848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1f3a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba1b3 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787707514.154194:0:15848:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:2.0:1787707514.154203:0:15848:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1787707514.154259:0:15848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1787707514.154689:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec1f41 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.154704:0:15848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec1f41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.154717:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec1f41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.154778:0:15848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871a400/0xc5f18d5f94ec1f3a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1b3 expref: 28 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.154809:0:15848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec1f41 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1b3 expref: 27 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.154818:0:15848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfa12a49d00) 00010000:00010000:2.0:1787707514.154820:0:15848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787707514.154824:0:15848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fdc00, rc 0) 00000100:00100000:2.0:1787707514.154903:0:15848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+27:14533:x1874546707786112:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 1627us (2063us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787707514.154912:0:15848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 43 00000100:00100000:0.0:1787707514.159561:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707514.159991:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707786368 00000100:00100000:2.0:1787707514.160002:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707786368 00000100:00100000:2.0:1787707514.160069:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 44 00000100:00100000:2.0:1787707514.160080:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+27:14533:x1874546707786368:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787707514.160152:0:14430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707514.160182:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec1f41 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1b3 expref: 27 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.160201:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfa12a49d00) 00010000:00010000:2.0:1787707514.160211:0:14430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787707514.160234:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec1f4f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.160247:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec1f4f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.160257:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec1f4f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.160270:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1f56 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3d014b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.160277:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1f56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3d014b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.160283:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1f56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3d014b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.160359:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec1f4f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.160367:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec1f4f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.160396:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec1f4f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.160410:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fcc00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707514.160414:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec1f4f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.160420:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec1f4f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.160428:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cfa06897400) 00010000:00010000:2.0:1787707514.160431:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707514.160434:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec1f4f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.160439:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec1f4f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.160449:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1f56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3d014b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.160454:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1f56 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3d014b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.160459:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1f56 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3d014b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.160464:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:2.0:1787707514.160466:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1f56 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3d014b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.160472:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1f56 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3d014b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.160488:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x3d014b83 (ffff8cfa12a49700) 00010000:00010000:2.0:1787707514.160491:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787707514.160494:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1f56 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3d014b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.160509:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1f56 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3d014b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707514.160602:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+26:14533:x1874546707786368:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 Request processed in 524us (1050us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787707514.160609:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 44 00000100:00100000:0.0:1787707514.164455:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707514.164604:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707786496 00000100:00100000:3.0:1787707514.164614:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707786496 00000100:00100000:3.0:1787707514.164713:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 45 00000100:00100000:3.0:1787707514.164736:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+26:14533:x1874546707786496:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787707514.164763:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787707514.164799:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f5d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba1ba expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.164842:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1f64 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.164858:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1f64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.164869:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1f64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.164978:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f5d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1ba expref: 28 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.164997:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14400/0xc5f18d5f94ec1f64 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1ba expref: 27 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.165019:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfa12a27100) 00010000:00010000:3.0:1787707514.165021:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787707514.165025:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa41a14400, rc 0) 00000100:00100000:3.0:1787707514.165092:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+27:14533:x1874546707786496:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 369us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707514.165100:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 45 00000100:00100000:1.0:1787707514.174784:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707514.174971:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707786752 00000100:00100000:2.0:1787707514.174983:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707786752 00000100:00100000:2.0:1787707514.175051:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 46 00000100:00100000:2.0:1787707514.175064:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+27:14533:x1874546707786752:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787707514.176237:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1f6b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.176261:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1f6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.176275:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1f6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787707514.176743:0:14430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1787707514.176755:0:14430:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 565223383396ns, next at 566223380714ns, rc = 0 00000004:00010000:2.0:1787707514.176850:0:14430:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df813744 reply state 000000003ba3962d transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1f6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707514.176879:0:14430:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787707514.176992:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+29:14533:x1874546707786752:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 Request processed in 1928us (2215us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787707514.177001:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 46 00000100:00100000:0.0:1787707514.184134:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707514.185003:0:15848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707786880 00000100:00100000:2.0:1787707514.185014:0:15848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707786880 00000100:00100000:2.0:1787707514.185089:0:15848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 47 00000100:00100000:2.0:1787707514.185100:0:15848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+29:14533:x1874546707786880:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787707514.185125:0:15848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707514.185149:0:15848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec1f72 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba1c1 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.185330:0:15848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec1f72 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1c1 expref: 30 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.185346:0:15848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec1f72 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1c1 expref: 30 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.185367:0:15848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfa12a27100) 00010000:00010000:2.0:1787707514.185396:0:15848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787707514.185401:0:15848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fcc00, rc 0) 00000100:00100000:2.0:1787707514.185468:0:15848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+30:14533:x1874546707786880:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 369us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707514.185475:0:15848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 47 00010000:00010000:3.0:1787707514.186432:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1f6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.186446:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1f6b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.186454:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1f6b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.186460:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fc800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707514.186464:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1f6b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.186473:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1f6b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.186488:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfa12a27100) 00010000:00010000:3.0:1787707514.186491:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787707514.186495:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1f6b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.186501:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fc800/0xc5f18d5f94ec1f6b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707514.191586:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707514.191695:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707787008 00000100:00100000:2.0:1787707514.191706:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707787008 00000100:00100000:2.0:1787707514.191804:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 14 00000100:00100000:2.0:1787707514.191815:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+5:2362:x1874546707787008:12345-192.168.204.46@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787707514.192228:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787707514.192615:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+6:2362:x1874546707787008:12345-192.168.204.46@tcp:2:lhsmtool_posix.0 Request processed in 799us (1036us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787707514.192624:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 14 00000100:00100000:1.0:1787707514.204226:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707514.204325:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707787264 00000100:00100000:3.0:1787707514.204335:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707787264 00000100:00100000:3.0:1787707514.204423:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 9 00000100:00100000:3.0:1787707514.204435:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+29:14533:x1874546707787264:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787707514.204731:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+30:14533:x1874546707787264:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 Request processed in 297us (514us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1787707514.204739:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 9 00000100:00100000:0.0:1787707514.210077:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707514.210222:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707787520 00000100:00100000:3.0:1787707514.210232:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707787520 00000100:00100000:3.0:1787707514.210291:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 48 00000100:00100000:3.0:1787707514.210300:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+30:14533:x1874546707787520:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787707514.210548:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+30:14533:x1874546707787520:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 Request processed in 247us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707514.210556:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 48 00000100:00100000:1.0:1787707514.215908:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707514.216402:0:15848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707787648 00000100:00100000:2.0:1787707514.216414:0:15848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707787648 00000100:00100000:2.0:1787707514.216477:0:15848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 49 00000100:00100000:2.0:1787707514.216487:0:15848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa34c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+30:14533:x1874546707787648:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787707514.216517:0:15848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787707514.216540:0:15848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec1f79 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba1c8 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.216622:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd800/0xc5f18d5f94ec1f80 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.216638:0:15848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd800/0xc5f18d5f94ec1f80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.216649:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd800/0xc5f18d5f94ec1f80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787707514.216687:0:15848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787707514.216707:0:15848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd800/0xc5f18d5f94ec1f80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.216733:0:15848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec1f79 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1c8 expref: 32 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.216772:0:15848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd800/0xc5f18d5f94ec1f80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1c8 expref: 31 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.216781:0:15848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfa12a27100) 00010000:00010000:2.0:1787707514.216795:0:15848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787707514.216799:0:15848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa421fd800, rc 0) 00000100:00100000:2.0:1787707514.216876:0:15848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa34c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+31:14533:x1874546707787648:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 390us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707514.216883:0:15848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 49 00000100:00100000:1.0:1787707514.220155:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707514.220756:0:15297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707787776 00000100:00100000:0.0:1787707514.220767:0:15297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707787776 00000100:00100000:0.0:1787707514.220842:0:15297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 15 00000100:00100000:0.0:1787707514.220852:0:15297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08770a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+6:2361:x1874546707787776:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787707514.220887:0:15297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787707514.220909:0:15297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec1f87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x978f586bcd0ba1cf expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787707514.220938:0:15297:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8e4079, blocks: 0x1 00010000:00010000:0.0:1787707514.220957:0:15297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1787707514.220961:0:15297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707514.220971:0:15297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec1f87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1cf expref: 7 pid: 15297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.220990:0:15297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec1f87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1cf expref: 7 pid: 15297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.221005:0:15297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfa3fcd3000, rc 0) 00000100:00100000:0.0:1787707514.221076:0:15297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08770a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+7:2361:x1874546707787776:12345-192.168.204.46@tcp:101:lhsmtool_posix.0 Request processed in 225us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707514.221083:0:15297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 15 00000100:00100000:1.0:1787707514.226947:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707514.227056:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707788032 00000100:00100000:2.0:1787707514.227068:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707788032 00000100:00100000:2.0:1787707514.227137:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 50 00000100:00100000:2.0:1787707514.227161:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08772680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+31:14533:x1874546707788032:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787707514.227283:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08772680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+31:14533:x1874546707788032:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 Request processed in 135us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707514.227290:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 50 00000100:00100000:1.0:1787707514.230435:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707514.230542:0:15848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707788160 00000100:00100000:2.0:1787707514.230552:0:15848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707788160 00000100:00100000:2.0:1787707514.230614:0:15848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 51 00000100:00100000:2.0:1787707514.230625:0:15848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa08772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+31:14533:x1874546707788160:12345-192.168.204.46@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787707514.280453:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934607 is committed 00000001:00080000:2.0:1787707514.280474:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934608 is committed 00000001:00080000:2.0:1787707514.280484:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:2.0:1787707514.280494:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:2.0:1787707514.280498:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787707514.280537:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:2.0:1787707514.280557:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1787707514.280958:0:15848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa08772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+14:14533:x1874546707788160:12345-192.168.204.46@tcp:44:lhsmtool_posix.0 Request processed in 50328us (50524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707514.280970:0:15848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 51 00000100:00100000:3.0:1787707514.281781:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787707514.283425:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3fcbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729797120:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787707514.283514:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787707514.283800:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729797120 00000100:00100000:1.0:1787707514.283808:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729797120 00000100:00100000:1.0:1787707514.283879:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787707514.283889:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729797120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787707514.284873:0:15115:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787707514.284880:0:15115:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787707514.284882:0:15115:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787707514.284884:0:15115:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787707513 -> 1787707513 00002000:00010000:1.0:1787707514.284887:0:15115:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787707514.285021:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1874546729797120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1132us (1506us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787707514.285029:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1787707514.285113:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787707514.285521:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfa3fcbfb80/2, rc 0, transno 8589934595 00000100:00100000:3.0:1787707514.285530:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3fcbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729797120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787707514.286092:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707514.286540:0:15297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707788288 00000100:00100000:0.0:1787707514.286547:0:15297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707788288 00000100:00100000:0.0:1787707514.286589:0:15297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 17 00000100:00100000:0.0:1787707514.286598:0:15297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+7:2362:x1874546707788288:12345-192.168.204.46@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787707514.286696:0:15297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+7:2362:x1874546707788288:12345-192.168.204.46@tcp:16:lhsmtool_posix.0 Request processed in 98us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707514.286702:0:15297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 17 00000100:00100000:1.0:1787707514.293499:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707514.293743:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707788544 00000100:00100000:2.0:1787707514.293753:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707788544 00000100:00100000:2.0:1787707514.293817:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 52 00000100:00100000:2.0:1787707514.293833:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+14:14533:x1874546707788544:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787707514.293893:0:14430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707514.293942:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd800/0xc5f18d5f94ec1f80 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1c8 expref: 14 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.293970:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfa12a27100) 00010000:00010000:2.0:1787707514.293975:0:14430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787707514.294017:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec1f8e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.294033:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec1f8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.294047:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec1f8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787707514.294529:0:14430:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c97ee97 reply state 000000005e75f862 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec1f8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707514.294540:0:14430:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787707514.294719:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+15:14533:x1874546707788544:12345-192.168.204.46@tcp:36:lhsmtool_posix.0 Request processed in 887us (1233us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787707514.294728:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 52 00010000:00010000:3.0:1787707514.303746:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec1f8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.303779:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec1f8e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.303796:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec1f8e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.303802:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fdc00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707514.303807:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec1f8e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.303814:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec1f8e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.303831:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfa12a27100) 00010000:00010000:3.0:1787707514.303834:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707514.303838:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec1f8e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.303843:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fdc00/0xc5f18d5f94ec1f8e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707514.304802:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707514.308507:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707788672 00000100:00100000:3.0:1787707514.308524:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707788672 00000100:00100000:3.0:1787707514.308650:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 18 00000100:00100000:3.0:1787707514.308661:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+7:2360:x1874546707788672:12345-192.168.204.46@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787707514.308878:0:15116:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787707514.308882:0:15116:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787707512 00002000:00010000:3.0:1787707514.308885:0:15116:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787707512 00002000:00010000:3.0:1787707514.308887:0:15116:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787707513 -> 1787707512 00002000:00010000:3.0:1787707514.308902:0:15116:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787707514.308977:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+8:2360:x1874546707788672:12345-192.168.204.46@tcp:2:lhsmtool_posix.0 Request processed in 317us (4189us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787707514.308986:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 18 00000100:00100000:1.0:1787707514.317601:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707514.317819:0:15297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707788800 00000100:00100000:0.0:1787707514.317830:0:15297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707788800 00000100:00100000:0.0:1787707514.317933:0:15297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 19 00000100:00100000:0.0:1787707514.317944:0:15297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+8:2362:x1874546707788800:12345-192.168.204.46@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787707514.317989:0:15297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bb658bc4/0xc5f18d5f94ec1f95 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.318007:0:15297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707514.318012:0:15297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707514.318018:0:15297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb658bc4/0xc5f18d5f94ec1f95 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.318032:0:15297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb658bc4/0xc5f18d5f94ec1f95 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.318064:0:15297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bb658bc4/0xc5f18d5f94ec1f95 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.318073:0:15297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb658bc4/0xc5f18d5f94ec1f95 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.318091:0:15297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb658bc4/0xc5f18d5f94ec1f95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.318099:0:15297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2a00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:0.0:1787707514.318103:0:15297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb658bc4/0xc5f18d5f94ec1f95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.318142:0:15297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb658bc4/0xc5f18d5f94ec1f95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.318318:0:15297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb658bc4/0xc5f18d5f94ec1f95 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.318326:0:15297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb658bc4/0xc5f18d5f94ec1f95 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707514.318495:0:15297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+8:2362:x1874546707788800:12345-192.168.204.46@tcp:1:lhsmtool_posix.0 Request processed in 552us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707514.318503:0:15297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 19 00000100:00100000:0.0:1787707514.335488:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707514.335698:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707789056 00000100:00100000:3.0:1787707514.335709:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707789056 00000100:00100000:3.0:1787707514.335985:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 53 00000100:00100000:3.0:1787707514.335997:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+14:14533:x1874546707789056:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787707514.336079:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f9c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.336096:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f9c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.336108:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f9c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.336358:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1fa3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.336401:0:14429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec1f72 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1c1 expref: 15 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.336409:0:14429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1fa3 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.336460:0:14429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec1f72 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1c1 expref: 15 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.336476:0:14429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec1f72 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1c1 expref: 15 pid: 15848 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707514.336507:0:14429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14429:1874546729797248:192.168.204.46@tcp:104: 00000100:00100000:3.0:1787707514.336616:0:14429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07e17540 going to sleep for 11 seconds 00000100:00100000:3.0:1787707514.340020:0:14429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14429:1874546729797248:192.168.204.46@tcp:104: 00010000:00010000:3.0:1787707514.340050:0:14429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1fa3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707514.347508:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707514.347706:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707789184 00000100:00100000:2.0:1787707514.347727:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707789184 00010000:00010000:2.0:1787707514.347797:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec1f72 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1c1 expref: 16 pid: 15848 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707514.347879:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 13 00000100:00100000:2.0:1787707514.347889:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+16:2361:x1874546707789184:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787707514.347905:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707514.347912:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec1f72 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1c1 expref: 16 pid: 15848 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.347927:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec1f72 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1c1 expref: 16 pid: 15848 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.347949:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fcc00/0xc5f18d5f94ec1f72 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1c1 expref: 16 pid: 15848 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.347966:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfa12a27100) 00010000:00010000:2.0:1787707514.347971:0:14414:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1fa3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.347980:0:14414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1fa3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.347987:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1fa3 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.348016:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707514.348079:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+15:2361:x1874546707789184:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 191us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707514.348087:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 13 00010000:00010000:3.0:1787707514.348099:0:14429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1fa3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.348106:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1fa3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787707514.348367:0:14429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1787707514.348843:0:14429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1787707514.348891:0:14429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1787707514.348981:0:14429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3ac51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14429:1874546729797376:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787707514.349088:0:14429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707514.349250:0:14429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa07e17840 going to sleep for 11 seconds 00000100:00100000:1.0:1787707514.352833:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729797376 00000100:00100000:1.0:1787707514.352854:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729797376 00000100:00100000:1.0:1787707514.352913:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787707514.352924:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14429:x1874546729797376:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787707514.353543:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14429:x1874546729797376:12345-0@lo:1000:mdt00_000.0 Request processed in 577us (4411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707514.353553:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787707514.353738:0:14429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3ac51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14429:1874546729797376:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787707514.355040:0:14429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1787707514.355273:0:14429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3accb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14429:1874546729797504:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787707514.355334:0:14429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707514.355389:0:14429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1f91f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787707514.356323:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729797504 00000100:00100000:3.0:1787707514.356332:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729797504 00000100:00100000:3.0:1787707514.356442:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787707514.356453:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14429:x1874546729797504:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787707514.356692:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14429:x1874546729797504:12345-0@lo:1000:mdt00_000.0 Request processed in 239us (1356us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787707514.356700:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787707514.356812:0:14429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3accb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14429:1874546729797504:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787707514.356855:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1fa3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.356866:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1fa3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.356887:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1fa3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.356892:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15600 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707514.356897:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1fa3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.356906:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1fa3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.356922:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfa12a27100) 00010000:00010000:0.0:1787707514.356925:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787707514.356929:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1fa3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.356935:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15600/0xc5f18d5f94ec1fa3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.356966:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1f02 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.356972:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1f02 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.356978:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1f02 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.356983:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15800 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:0.0:1787707514.356986:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1f02 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.357001:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1f02 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.357010:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfa06897100) 00010000:00010000:0.0:1787707514.357012:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787707514.357020:0:14429:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1f09 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1a5 expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.357031:0:14429:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1f09 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1a5 expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.357041:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1f09 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1a5 expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.357093:0:14429:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa0871b400/0xc5f18d5f94ec1f09 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1a5 expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707514.357108:0:14429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14429:1874546729797632:192.168.204.46@tcp:105: 00000100:00100000:0.0:1787707514.357194:0:14429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa1f91f240 going to sleep for 11 seconds 00000100:00100000:3.0:1787707514.364836:0:14429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14429:1874546729797632:192.168.204.46@tcp:105: 00010000:00010000:3.0:1787707514.364884:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1f02 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.364895:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15800/0xc5f18d5f94ec1f02 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.364931:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec1faa lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.364946:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec1faa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.364958:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec1faa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.364969:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec1faa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.364976:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec1faa lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.364982:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec1faa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.364988:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15200 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707514.364991:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec1faa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.364997:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec1faa lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.365008:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfa06897100) 00010000:00010000:3.0:1787707514.365018:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787707514.365022:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec1faa lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.365028:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a15200/0xc5f18d5f94ec1faa lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.365038:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f9c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.365043:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f9c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.365049:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f9c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.365054:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14a00 already unused, calling callback (ffffffffc206f4f0) 00010000:00010000:3.0:1787707514.365057:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f9c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.365062:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f9c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.365070:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfa06897100) 00010000:00010000:3.0:1787707514.365072:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787707514.365074:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f9c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.365080:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa41a14a00/0xc5f18d5f94ec1f9c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707514.366349:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+18:14533:x1874546707789056:12345-192.168.204.46@tcp:57:lhsmtool_posix.0 Request processed in 30345us (30863us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1787707514.366397:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 53 00000020:00080000:3.0:1787707514.366405:0:14429:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787707514.368526:0:14460:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787707514.368535:0:14460:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787707514.368580:0:14460:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787707514.368586:0:14460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787707514.371094:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707514.372262:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707789312 00000100:00100000:3.0:1787707514.372276:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707789312 00000100:00100000:2.0:1787707514.372623:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 10 00000100:00100000:2.0:1787707514.372634:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa2f35e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+18:14532:x1874546707789312:12345-192.168.204.46@tcp:49:dd.0 00000100:00100000:2.0:1787707514.373131:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa2f35e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+18:14532:x1874546707789312:12345-192.168.204.46@tcp:49:dd.0 Request processed in 488us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707514.373139:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 10 00000100:00100000:0.0:1787707514.379450:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707514.379576:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707789568 00000100:00100000:2.0:1787707514.379587:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707789568 00000100:00100000:2.0:1787707514.379641:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 11 00000100:00100000:2.0:1787707514.379652:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3accaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+18:14533:x1874546707789568:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787707514.380891:0:14433:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787707514.381011:0:14433:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787707514.381064:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1fb1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.381081:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1fb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.381091:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1fb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.381100:0:14433:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1fb1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.381106:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1fb1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.381112:0:14433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1fb1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.381551:0:14433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787707514.381655:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3accaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+20:14533:x1874546707789568:12345-192.168.204.46@tcp:35:lhsmtool_posix.0 Request processed in 2000us (2223us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787707514.381737:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 11 00000020:00080000:2.0:1787707514.381742:0:14433:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787707514.391429:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787707514.391443:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1fb1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.391453:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd400 already unused, calling callback (ffffffffc1630230) 00010000:00010000:0.0:1787707514.391458:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1fb1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.391482:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1fb1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.391506:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfa12a27100) 00010000:00010000:0.0:1787707514.391509:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787707514.391514:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1fb1 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.391520:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfa421fd400/0xc5f18d5f94ec1fb1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.391539:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707514.391541:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787707514.391543:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787707514.549081:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:0.0:1787707514.549181:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:3.0:1787707514.553680:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707789696 00000100:00100000:3.0:1787707514.553694:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707789696 00000100:00100000:0.0:1787707514.553849:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:1.0:1787707514.553865:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707789824 00000100:00100000:1.0:1787707514.553870:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707789824 00000100:00100000:1.0:1787707514.553913:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707789952 00000100:00100000:1.0:1787707514.553916:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707789952 00000100:00100000:1.0:1787707514.553934:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 0 00000100:00100000:1.0:1787707514.553943:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+10:2362:x1874546707789824:12345-192.168.204.46@tcp:4:dd.0 00000100:00100000:2.0:1787707514.553945:0:15121:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787707514.553953:0:15121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00010000:00010000:1.0:1787707514.553977:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031dece36/0xc5f18d5f94ec1fb8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707514.553999:0:15120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec1f87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1cf expref: 10 pid: 15297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707514.554015:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707514.554019:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787707514.554024:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031dece36/0xc5f18d5f94ec1fb8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707514.554061:0:15120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec1f87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1cf expref: 10 pid: 15297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707514.554076:0:15120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec1f87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1cf expref: 10 pid: 15297 timeout: 665 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707514.554091:0:15120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:15120:1874546729797760:192.168.204.46@tcp:104: 00000100:00100000:1.0:1787707514.554188:0:15120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfa0580d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787707514.555683:0:16662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 1 00000100:00100000:3.0:1787707514.555697:0:16662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+10:2361:x1874546707789952:12345-192.168.204.46@tcp:4:dd.0 00010000:00010000:3.0:1787707514.555743:0:16662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1fbf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.555762:0:16662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707514.555766:0:16662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707514.555770:0:16662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1fbf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.555790:0:16662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1fbf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707514.558592:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707514.558627:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707514.558654:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707514.558680:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707514.558692:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707514.558769:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707514.558815:0:16661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707790720 00000100:00100000:2.0:1787707514.558824:0:16661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707790720 00000100:00100000:1.0:1787707514.558843:0:15120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:15120:1874546729797760:192.168.204.46@tcp:104: 00010000:00010000:2.0:1787707514.558858:0:16661:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec1f87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1cf expref: 11 pid: 15297 timeout: 665 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707514.558866:0:15120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000031dece36/0xc5f18d5f94ec1fb8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707514.558894:0:16661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 14 00000100:00100000:2.0:1787707514.558903:0:16661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+11:2362:x1874546707790720:12345-192.168.204.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787707514.558918:0:16661:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787707514.558942:0:16661:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec1f87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1cf expref: 11 pid: 15297 timeout: 665 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.558957:0:16661:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec1f87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1cf expref: 11 pid: 15297 timeout: 665 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.558981:0:16661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa7a8a79/0xc5f18d5f94ec1f87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.46@tcp remote: 0x978f586bcd0ba1cf expref: 11 pid: 15297 timeout: 665 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.559008:0:16661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707514.559013:0:16661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707514.559018:0:16661:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000031dece36/0xc5f18d5f94ec1fb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.559028:0:16661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031dece36/0xc5f18d5f94ec1fb8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.559039:0:16661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707514.559041:0:16661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707514.559046:0:16661:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1fbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.559054:0:16661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1fbf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.559087:0:16661:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787707514.559132:0:16661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+10:2362:x1874546707790720:12345-192.168.204.46@tcp:103:ldlm_bl.0 Request processed in 230us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707514.559140:0:16661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 14 00010000:00010000:1.0:1787707514.559141:0:15120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000031dece36/0xc5f18d5f94ec1fb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707514.559156:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031dece36/0xc5f18d5f94ec1fb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707514.559632:0:15121:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1787707514.559642:0:15121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1787707514.559957:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707790208 00000100:00100000:0.0:1787707514.559964:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707790208 00000100:00100000:0.0:1787707514.559994:0:15121:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1787707514.560000:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707790464 00000100:00100000:0.0:1787707514.560002:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707790464 00000100:00100000:0.0:1787707514.560013:0:15121:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1787707514.560017:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707790080 00000100:00100000:0.0:1787707514.560019:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707790080 00000100:00100000:0.0:1787707514.560030:0:15121:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1787707514.560034:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707790336 00000100:00100000:0.0:1787707514.560036:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707790336 00000100:00100000:0.0:1787707514.560046:0:15121:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1787707514.560055:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707790592 00000100:00100000:0.0:1787707514.560058:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707790592 00000100:00100000:0.0:1787707514.560474:0:16663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 2 00000100:00100000:0.0:1787707514.560483:0:16663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3acc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+15:2361:x1874546707789696:12345-192.168.204.46@tcp:4:dd.0 00010000:00010000:1.0:1787707514.560492:0:16662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1fbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707514.560507:0:16662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1fbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.560511:0:16663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067f7cc85/0xc5f18d5f94ec1fc6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.560522:0:16663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707514.560526:0:16663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707514.560531:0:16663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067f7cc85/0xc5f18d5f94ec1fc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.560542:0:16663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067f7cc85/0xc5f18d5f94ec1fc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787707514.670272:0:15120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:3.0:1787707514.670282:0:15120:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787707512 -> 1787707513 00002000:00010000:3.0:1787707514.670285:0:15120:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787707512 -> 1787707513 00002000:00010000:3.0:1787707514.670287:0:15120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:3.0:1787707514.670304:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031dece36/0xc5f18d5f94ec1fb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.670317:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031dece36/0xc5f18d5f94ec1fb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.670341:0:15120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031dece36/0xc5f18d5f94ec1fb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.670348:0:15120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa029d4000 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707514.670353:0:15120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031dece36/0xc5f18d5f94ec1fb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.670362:0:15120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031dece36/0xc5f18d5f94ec1fb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.670413:0:15120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031dece36/0xc5f18d5f94ec1fb8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.670422:0:15120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031dece36/0xc5f18d5f94ec1fb8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707514.670512:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+22:2362:x1874546707789824:12345-192.168.204.46@tcp:4:dd.0 Request processed in 116565us (121326us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1787707514.670521:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 0 00000100:00100000:3.0:1787707514.670554:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 3 00000100:00100000:3.0:1787707514.670565:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+21:2361:x1874546707790208:12345-192.168.204.46@tcp:4:dd.0 00010000:00010000:3.0:1787707514.670597:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ae52c3e/0xc5f18d5f94ec1fcd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.670609:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707514.670620:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707514.670627:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ae52c3e/0xc5f18d5f94ec1fcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.670638:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ae52c3e/0xc5f18d5f94ec1fcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787707514.671010:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:3.0:1787707514.671022:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:3.0:1787707514.671033:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000100:00100000:2.0:1787707514.682687:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729797888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787707514.682769:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707514.685130:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729797888 00000100:00100000:0.0:1787707514.685155:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729797888 00000100:00100000:0.0:1787707514.685215:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787707514.685227:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729797888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787707514.685253:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 62980096 pending 5111808 free 3859808256 avail 3856662528 00000100:00100000:0.0:1787707514.685333:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874546729797888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (2565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707514.685341:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787707514.685408:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1787707514.685413:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfa3fcbfb80, transno 8589934595 00000004:00080000:0.0:1787707514.685425:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1787707514.685452:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874546729797888:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787707514.728465:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1787707514.728485:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1787707514.728707:0:16662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:2.0:1787707514.728718:0:16662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 6151 00010000:00010000:2.0:1787707514.728734:0:16662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1fbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.728763:0:16662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1fbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.728914:0:16662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1fbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.728922:0:16662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14a00 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707514.728928:0:16662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1fbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.728939:0:16662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1fbf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.728962:0:16662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1fbf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.728970:0:16662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035fb9ba4/0xc5f18d5f94ec1fbf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707514.729069:0:16662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+15:2361:x1874546707789952:12345-192.168.204.46@tcp:4:dd.0 Request processed in 173372us (175220us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787707514.729080:0:16662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 1 00000100:00100000:2.0:1787707514.729112:0:16662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 4 00000100:00100000:2.0:1787707514.729124:0:16662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+14:2361:x1874546707790464:12345-192.168.204.46@tcp:4:dd.0 00010000:00010000:2.0:1787707514.729155:0:16662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1fd4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.729173:0:16662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707514.729178:0:16662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787707514.729184:0:16662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1fd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.729196:0:16662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1fd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.730771:0:16663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067f7cc85/0xc5f18d5f94ec1fc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.730798:0:16663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067f7cc85/0xc5f18d5f94ec1fc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.730806:0:16663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067f7cc85/0xc5f18d5f94ec1fc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.730813:0:16663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd2600 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707514.730817:0:16663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067f7cc85/0xc5f18d5f94ec1fc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.730824:0:16663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067f7cc85/0xc5f18d5f94ec1fc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.730842:0:16663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067f7cc85/0xc5f18d5f94ec1fc6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.730865:0:16663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067f7cc85/0xc5f18d5f94ec1fc6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707514.730957:0:16663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3acc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+14:2361:x1874546707789696:12345-192.168.204.46@tcp:4:dd.0 Request processed in 170473us (181885us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787707514.730967:0:16663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 2 00000100:00100000:3.0:1787707514.730995:0:16663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 5 00000100:00100000:3.0:1787707514.731005:0:16663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+13:2361:x1874546707790080:12345-192.168.204.46@tcp:4:dd.0 00010000:00010000:3.0:1787707514.731030:0:16663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efc16c90/0xc5f18d5f94ec1fdb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.731042:0:16663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707514.731045:0:16663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707514.731051:0:16663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efc16c90/0xc5f18d5f94ec1fdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.731061:0:16663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efc16c90/0xc5f18d5f94ec1fdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.745623:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787707514.766061:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:3.0:1787707514.766180:0:15120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1787707514.766196:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ae52c3e/0xc5f18d5f94ec1fcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.766209:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ae52c3e/0xc5f18d5f94ec1fcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.766241:0:15120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ae52c3e/0xc5f18d5f94ec1fcd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.766248:0:15120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15200 already unused, calling callback (ffffffffc1630230) 00010000:00010000:3.0:1787707514.766252:0:15120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ae52c3e/0xc5f18d5f94ec1fcd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.766261:0:15120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ae52c3e/0xc5f18d5f94ec1fcd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.766281:0:15120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ae52c3e/0xc5f18d5f94ec1fcd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.766289:0:15120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ae52c3e/0xc5f18d5f94ec1fcd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787707514.766490:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+11:2361:x1874546707790208:12345-192.168.204.46@tcp:4:dd.0 Request processed in 95922us (207902us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787707514.766500:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 3 00000100:00100000:3.0:1787707514.766532:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 6 00000100:00100000:3.0:1787707514.766543:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+10:2361:x1874546707790336:12345-192.168.204.46@tcp:4:dd.0 00010000:00010000:3.0:1787707514.766576:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5575ae4/0xc5f18d5f94ec1fe2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.766588:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707514.767031:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787707514.767038:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5575ae4/0xc5f18d5f94ec1fe2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787707514.767052:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5575ae4/0xc5f18d5f94ec1fe2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787707514.872405:0:16662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:0.0:1787707514.872415:0:16662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:0.0:1787707514.872430:0:16662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1fd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.872443:0:16662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1fd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.872453:0:16662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1fd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.872461:0:16662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa421fd200 already unused, calling callback (ffffffffc1630230) 00010000:00010000:0.0:1787707514.872466:0:16662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1fd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.872476:0:16662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1fd4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.872495:0:16662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1fd4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.872503:0:16662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bca2978f/0xc5f18d5f94ec1fd4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787707514.872614:0:16662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+16:2361:x1874546707790464:12345-192.168.204.46@tcp:4:dd.0 Request processed in 143488us (313981us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1787707514.872625:0:16662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 4 00000100:00100000:0.0:1787707514.872663:0:16662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 7 00000100:00100000:0.0:1787707514.872675:0:16662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+15:2361:x1874546707790592:12345-192.168.204.46@tcp:4:dd.0 00010000:00010000:0.0:1787707514.872706:0:16662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baa043f6/0xc5f18d5f94ec1fe9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.872719:0:16662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707514.872724:0:16662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787707514.872730:0:16662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000baa043f6/0xc5f18d5f94ec1fe9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787707514.872743:0:16662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000baa043f6/0xc5f18d5f94ec1fe9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787707514.873026:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:2.0:1787707514.904594:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00000001:00080000:2.0:1787707514.904627:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:1.0:1787707514.905097:0:15120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1787707514.905102:0:15120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:1.0:1787707514.905117:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5575ae4/0xc5f18d5f94ec1fe2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707514.905129:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5575ae4/0xc5f18d5f94ec1fe2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707514.905137:0:15120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5575ae4/0xc5f18d5f94ec1fe2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707514.905215:0:15120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a14000 already unused, calling callback (ffffffffc1630230) 00010000:00010000:1.0:1787707514.905222:0:15120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5575ae4/0xc5f18d5f94ec1fe2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707514.905231:0:15120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5575ae4/0xc5f18d5f94ec1fe2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707514.905251:0:15120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5575ae4/0xc5f18d5f94ec1fe2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707514.905258:0:15120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5575ae4/0xc5f18d5f94ec1fe2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707514.905402:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+11:2361:x1874546707790336:12345-192.168.204.46@tcp:4:dd.0 Request processed in 138828us (346687us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787707514.905411:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 6 00002000:00010000:1.0:1787707514.911175:0:16663:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1787707514.911197:0:16663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efc16c90/0xc5f18d5f94ec1fdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707514.911211:0:16663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efc16c90/0xc5f18d5f94ec1fdb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707514.911221:0:16663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efc16c90/0xc5f18d5f94ec1fdb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707514.911228:0:16663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa41a15800 already unused, calling callback (ffffffffc1630230) 00010000:00010000:1.0:1787707514.911233:0:16663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efc16c90/0xc5f18d5f94ec1fdb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707514.911241:0:16663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efc16c90/0xc5f18d5f94ec1fdb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707514.911262:0:16663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efc16c90/0xc5f18d5f94ec1fdb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787707514.911270:0:16663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efc16c90/0xc5f18d5f94ec1fdb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787707514.911398:0:16663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+9:2361:x1874546707790080:12345-192.168.204.46@tcp:4:dd.0 Request processed in 180389us (352736us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787707514.911408:0:16663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 5 00010000:00010000:2.0:1787707514.936508:0:16662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baa043f6/0xc5f18d5f94ec1fe9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.936530:0:16662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000baa043f6/0xc5f18d5f94ec1fe9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.936539:0:16662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000baa043f6/0xc5f18d5f94ec1fe9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.936546:0:16662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfa3fcd3200 already unused, calling callback (ffffffffc1630230) 00010000:00010000:2.0:1787707514.936551:0:16662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000baa043f6/0xc5f18d5f94ec1fe9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.936561:0:16662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000baa043f6/0xc5f18d5f94ec1fe9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.936597:0:16662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000baa043f6/0xc5f18d5f94ec1fe9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787707514.936605:0:16662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000baa043f6/0xc5f18d5f94ec1fe9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787707514.936850:0:16662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+7:2361:x1874546707790592:12345-192.168.204.46@tcp:4:dd.0 Request processed in 64102us (378080us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787707514.936862:0:16662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 7 00000001:00080000:2.0:1787707514.936901:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:3.0:1787707515.769605:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787707515.782235:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707515.782280:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707515.782315:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707515.782337:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707515.782355:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707515.782401:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707515.782428:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.46@tcp (source: 12345-192.168.204.46@tcp) 00000100:00100000:2.0:1787707515.782462:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707791360 00000100:00100000:2.0:1787707515.782476:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707791360 00000100:00100000:2.0:1787707515.782543:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707790976 00000100:00100000:2.0:1787707515.782546:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707790976 00000100:00100000:2.0:1787707515.782569:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 30 00000100:00100000:2.0:1787707515.782580:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+6:2359:x1874546707791360:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707515.782748:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707790848 00000100:00100000:1.0:1787707515.782753:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707790848 00000100:00100000:1.0:1787707515.782914:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 125 00000100:00100000:1.0:1787707515.782922:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+13:2359:x1874546707790848:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707515.782993:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff6c02c6-40c8-45e5-a3f5-0e1e7d56dab8+13:2359:x1874546707790848:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 72us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707515.783001:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 125 00000100:00100000:1.0:1787707515.783202:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707791104 00000100:00100000:1.0:1787707515.783208:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707791104 00000100:00100000:1.0:1787707515.783227:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707791616 00000100:00100000:1.0:1787707515.783230:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707791616 00000100:00100000:1.0:1787707515.783245:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707791232 00000100:00100000:1.0:1787707515.783247:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707791232 00000100:00100000:1.0:1787707515.783260:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546707791488 00000100:00100000:1.0:1787707515.783262:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546707791488 00000100:00100000:1.0:1787707515.783278:0:15113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 18 00000100:00100000:1.0:1787707515.783284:0:15113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+5:2359:x1874546707791104:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707515.783318:0:15113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+5:2359:x1874546707791104:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 33us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707515.783325:0:15113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 18 00000100:00100000:1.0:1787707515.783337:0:15113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 19 00000100:00100000:1.0:1787707515.783343:0:15113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+5:2359:x1874546707791616:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707515.783399:0:15113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+5:2359:x1874546707791616:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 56us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707515.783407:0:15113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 19 00000100:00100000:1.0:1787707515.783421:0:15113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 20 00000100:00100000:1.0:1787707515.783427:0:15113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+5:2359:x1874546707791232:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707515.783451:0:15113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+5:2359:x1874546707791232:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 24us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707515.783458:0:15113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 20 00000100:00100000:1.0:1787707515.783470:0:15113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 21 00000100:00100000:1.0:1787707515.783475:0:15113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+5:2359:x1874546707791488:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707515.783497:0:15113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f288ac8a-880e-4537-b6b8-0ab57669b2f5+5:2359:x1874546707791488:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 21us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707515.783502:0:15113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 21 00000100:00100000:1.0:1787707515.783524:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.46@tcp, seq: 31 00000100:00100000:1.0:1787707515.783533:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+20:2359:x1874546707790976:12345-192.168.204.46@tcp:400:kworker.0 00000100:00100000:1.0:1787707515.783564:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9f4cba3-9e74-47aa-919e-a4582dd7e4ec+20:2359:x1874546707790976:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 34us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707515.783570:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 31 00000100:00080000:0.0:1787707515.783933:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787707515.783939:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787707515.783943:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787707515.784230:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f288ac8a-880e-4537-b6b8-0ab57669b2f5+6:2359:x1874546707791360:12345-192.168.204.46@tcp:400:kworker.0 Request processed in 1647us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707515.784239:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.46@tcp, seq: 30 00000001:02000400:0.0:1787707516.649574:0:16702:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1787707516.795003:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787707517.240810:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa3acc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729798016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787707517.240889:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787707517.241031:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729798016 00000100:00100000:0.0:1787707517.241043:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729798016 00000100:00100000:0.0:1787707517.241113:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787707517.241137:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729798016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787707517.241261:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787707517.241397:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874546729798016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 262us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787707517.241405:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787707517.241453:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa3acc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874546729798016:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787707517.241623:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787707517.241931:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729798528:0@lo:400:kworker.0 00000100:00100000:3.0:1787707517.241970:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707517.242003:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787707517.242009:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a4807cb1-ea3f-4016-a232-153195075fb5:3316:1874546729798144:0@lo:400:kworker.0 00000100:00100000:3.0:1787707517.242037:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787707517.242061:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874546729798656:0@lo:400:kworker.0 00000100:00100000:3.0:1787707517.242083:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707517.242161:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729798272:0@lo:400:kworker.0 00000100:00100000:2.0:1787707517.242196:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707517.242227:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787707517.242232:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfa35b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729798400:0@lo:400:kworker.0 00000100:00100000:2.0:1787707517.242254:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787707517.242281:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729798144 00000100:00100000:2.0:1787707517.242286:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729798144 00000100:00100000:2.0:1787707517.242327:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787707517.242335:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3aa93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+19:3316:x1874546729798144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787707517.242398:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3aa93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4807cb1-ea3f-4016-a232-153195075fb5+19:3316:x1874546729798144:12345-0@lo:400:kworker.0 Request processed in 64us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787707517.242405:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787707517.242444:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a4807cb1-ea3f-4016-a232-153195075fb5:3316:1874546729798144:0@lo:400:kworker.0 00000100:00100000:1.0:1787707517.243035:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729798528 00000100:00100000:1.0:1787707517.243042:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729798528 00000100:00100000:1.0:1787707517.243094:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729798656 00000100:00100000:1.0:1787707517.243097:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729798656 00000100:00100000:1.0:1787707517.243112:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729798400 00000100:00100000:1.0:1787707517.243114:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729798400 00000100:00100000:1.0:1787707517.243155:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787707517.243164:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3ac51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729798528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707517.243216:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3ac51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874546729798528:12345-0@lo:400:kworker.0 Request processed in 54us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707517.243222:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787707517.243237:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787707517.243242:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa41c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874546729798656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707517.243267:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa41c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874546729798656:12345-0@lo:400:kworker.0 Request processed in 25us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707517.243272:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787707517.243283:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787707517.243289:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729798400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787707517.243317:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874546729798400:12345-0@lo:400:kworker.0 Request processed in 29us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787707517.243322:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787707517.243563:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874546729798272 00000100:00100000:3.0:1787707517.243568:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874546729798272 00000100:00100000:3.0:1787707517.243606:0:15113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787707517.243613:0:15113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfa3fcbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729798272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787707517.243649:0:15113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfa3fcbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874546729798272:12345-0@lo:400:kworker.0 Request processed in 37us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787707517.243668:0:15113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1787707517.245502:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787707517.245512:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787707517.245566:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874546729798400:0@lo:400:kworker.0 00000100:00100000:2.0:1787707517.245584:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874546729798272:0@lo:400:kworker.0 00000100:00100000:2.0:1787707517.245631:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874546729798656:0@lo:400:kworker.0 00000100:00100000:2.0:1787707517.245643:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfa35b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874546729798528:0@lo:400:kworker.0 00010000:00010000:0.0:1787707517.817311:0:15300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30381 lines, 30381 kept, 0 dropped, 0 bad.